-- Logs begin at Mon 2022-07-18 15:49:03 UTC, end at Mon 2022-07-18 17:01:08 UTC. -- Jul 18 16:29:22.415815 dv-cinder-837543-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:29:22.426205 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:29:22.430174 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:29:22 2022] *** Jul 18 16:29:22.430500 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:29:22.430695 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:29:22.430859 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: nodename: dv-cinder-837543-6-iscsi Jul 18 16:29:22.431021 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: machine: x86_64 Jul 18 16:29:22.431170 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: clock source: unix Jul 18 16:29:22.431318 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: pcre jit disabled Jul 18 16:29:22.431473 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: detected number of CPU cores: 4 Jul 18 16:29:22.431636 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: current working directory: / Jul 18 16:29:22.431797 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:29:22.431967 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: your processes number limit is 47680 Jul 18 16:29:22.432130 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: your memory page size is 4096 bytes Jul 18 16:29:22.432303 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: detected max file descriptor number: 2048 Jul 18 16:29:22.432481 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: lock engine: pthread robust mutexes Jul 18 16:29:22.432887 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: thunder lock: enabled Jul 18 16:29:22.433334 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:29:22.433643 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:29:22.477415 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: Python main interpreter initialized at 0x561dabeaf9c0 Jul 18 16:29:22.477415 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: python threads support enabled Jul 18 16:29:22.477415 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: your server socket listen backlog is limited to 100 connections Jul 18 16:29:22.477415 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:29:22.478036 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:29:22.478036 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: *** Operational MODE: preforking *** Jul 18 16:29:22.478346 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:29:22.478346 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: spawned uWSGI master process (pid: 103420) Jul 18 16:29:22.478644 dv-cinder-837543-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:29:22.480254 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: spawned uWSGI worker 1 (pid: 103433, cores: 1) Jul 18 16:29:22.480254 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: spawned uWSGI worker 2 (pid: 103434, cores: 1) Jul 18 16:29:22.480254 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:29:23.207366 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:29:23.225776 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:29:24.339466 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:29:24.339466 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: from cryptography.utils import int_from_bytes Jul 18 16:29:24.340187 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:29:24.340187 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: from cryptography.utils import int_from_bytes Jul 18 16:29:24.547932 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:29:24.547932 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: from cryptography.utils import int_from_bytes Jul 18 16:29:24.548780 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:29:24.548780 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: from cryptography.utils import int_from_bytes Jul 18 16:29:26.998293 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:29:26.999365 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:29:26.999365 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:29:26.999644 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:29:26.999859 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:29:27.000307 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.000643 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.000974 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.001301 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.001637 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.001955 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.002829 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.003159 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.003493 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.003763 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.004085 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.004415 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-6-iscsi {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.004741 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.005054 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.005371 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.005695 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.006004 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.006330 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.006669 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.006855 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:29:27.007586 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:29:27.007781 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.007994 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:29:27.008188 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.008385 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:29:27.008588 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.008788 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:29:27.008973 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.009165 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.009359 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.009546 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.009692 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.009908 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.010115 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.010313 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.010517 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.010687 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.010838 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011034 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011173 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011336 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011599 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011743 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.011865 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-6-iscsi {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012057 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012209 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012357 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012489 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012621 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012753 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012899 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-6-iscsi {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.012899 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.013177 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.013328 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.013478 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.013626 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.013843 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.014065 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.014271 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.014515 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.014739 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.014946 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015108 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015260 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015410 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015410 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015742 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.015928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016083 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016371 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016575 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016762 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.016934 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017108 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017259 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017412 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017575 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017736 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017951 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.017951 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.018787 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.018935 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019098 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019252 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019252 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019530 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019686 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.019832 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020006 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020006 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020299 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-6-iscsi {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020454 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020454 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020739 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.020880 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021036 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021176 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021343 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021483 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021483 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021748 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.021901 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.022053 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.022203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.022678 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.022835 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.022835 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023112 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023303 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023441 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023591 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023591 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.023874 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024022 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024184 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024328 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024466 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024600 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024736 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024876 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.024876 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025144 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025306 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025445 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025586 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025760 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025912 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.025912 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.026184 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.026325 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.026649 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.026828 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.026828 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.027277 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.027525 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.027697 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.027862 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028062 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028211 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028377 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028523 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028676 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028835 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.028998 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029145 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029294 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029439 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029594 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029756 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.029897 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030044 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030197 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030348 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030571 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030727 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.030869 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031023 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031182 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031336 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031492 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031640 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031794 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.031943 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032089 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032238 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032400 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032572 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032713 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.032857 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.033016 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.033158 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.033308 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.033734 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.033889 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034033 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034173 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034345 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034535 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034659 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034805 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034930 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.034930 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035197 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035331 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035452 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035582 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035733 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.035880 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036010 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036164 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036316 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036454 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036634 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.036848 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037031 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037485 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037629 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.037793 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038053 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038209 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038362 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038527 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038748 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.038894 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039059 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039211 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039354 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039506 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039649 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039790 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039944 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.039944 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040185 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040331 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040472 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040612 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040755 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.040898 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041204 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041530 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041683 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041836 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.041836 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042133 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042295 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042485 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042662 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042812 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042960 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.042960 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043243 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043398 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043398 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043682 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043840 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.043840 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.044120 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.044266 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.044428 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.044573 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.044573 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.044954 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.045149 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.045320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.045466 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.045466 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.045768 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.046060 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.046060 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.046385 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.046601 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.046748 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.046890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.046890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.047145 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.047285 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.047285 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.047540 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.047698 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.047854 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.047997 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.048188 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.048439 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.048596 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.048831 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.048979 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.049196 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.049473 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.049639 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.049821 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.050026 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.050175 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.050492 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.050670 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.050814 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.051053 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.051303 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.051456 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.051615 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.051791 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.052086 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.052238 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.052423 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.052622 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.052789 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.053053 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.053215 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.053359 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.053614 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.053767 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.053969 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.054151 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.054311 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.054640 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.054809 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.054941 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.055189 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.055344 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.055561 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.055719 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.055866 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.056174 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.056325 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.056483 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.056707 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.056875 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.057124 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.057257 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.057471 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.057724 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.057896 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.058061 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.058255 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.058509 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.058681 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.058824 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.058967 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.059264 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.059428 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.059594 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.059814 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.059977 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.060163 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.060371 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.060534 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.060787 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.060948 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.061110 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.061377 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.061530 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.061741 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.061907 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.062117 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.062354 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.062545 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:29:27.062694 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.062993 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.063281 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.063427 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.063569 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.063725 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.063882 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.064133 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.064289 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.064521 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.065221 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.065384 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.065701 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.065868 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.066028 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.066289 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.066475 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.066644 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.066924 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.067091 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.067304 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.067434 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.067625 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.067908 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.068075 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.068251 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.068468 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.068618 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.068890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.069052 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.069196 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.069492 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.069646 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.069866 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.070014 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.070157 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.070660 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.070816 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.070960 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.071123 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.071259 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.071524 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.071718 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.071869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072064 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072271 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072433 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072662 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072810 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.072975 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.073518 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.073668 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.073811 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.074069 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.074234 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.074390 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.074650 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.074804 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.075040 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.075201 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.075345 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.075649 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.075870 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.076035 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.076244 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.076424 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.076582 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.076870 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.077015 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.077218 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.077410 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.077544 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.077867 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.078019 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.078194 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.078492 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.078666 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.078854 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.079013 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.079156 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.079480 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.079630 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.079789 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.080014 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.080165 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.080475 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.081136 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.081299 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.081589 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.081805 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.081987 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.082221 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.082384 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.082641 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.082800 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.082943 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.083181 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.083328 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.083503 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.083827 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.083982 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.084178 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.084376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.084527 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.084815 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.084988 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.085134 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.085379 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.085532 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.085730 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.085909 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.086077 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.086324 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.086567 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.086712 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.086974 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.087123 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.087286 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.087543 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.087809 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.087972 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.088113 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.088255 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.088513 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.088702 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.088848 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.089110 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.089274 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.089443 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.089661 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.089810 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.090098 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.090249 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.090393 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.090691 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.090844 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.091056 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.091216 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.091359 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.091672 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.091851 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092008 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092259 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092412 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092558 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092759 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.092969 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.093174 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.093367 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.093526 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.093788 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.093951 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.094095 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.094384 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.094605 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.094781 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.094988 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.095155 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.095314 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.095527 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.095677 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096015 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096170 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096327 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096584 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096755 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.096901 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.097117 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.097282 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.097502 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.097659 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.097860 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.098131 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.098355 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.098554 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.098698 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.098856 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.099058 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.099231 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.099413 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.099736 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.099888 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.100032 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.100298 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.100449 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.100662 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.100931 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.101077 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.101279 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.101427 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.101572 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.101863 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.102017 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.102202 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.102537 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.102711 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.102856 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103009 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103151 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103460 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103613 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103758 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.103988 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.104165 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.104382 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.104530 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.104673 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.104988 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.105140 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.105296 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.105534 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.105687 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.105889 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.106074 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.106223 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.106592 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.106817 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.107104 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.107257 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.107463 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.107671 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.107832 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.108137 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.108290 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.108487 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.108731 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.108908 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.109051 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.109284 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.109436 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.109698 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.109860 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.110016 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.110292 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.110470 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.110616 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.110856 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.111007 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.111222 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.111383 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.112051 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.112357 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.112570 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.112718 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.112900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.113065 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.113253 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.113451 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.113620 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.113852 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.114012 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.114167 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.114511 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.114666 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.114812 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.115012 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.115188 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.115403 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.115553 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.115692 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116010 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116164 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116308 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116608 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116790 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.116964 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.117128 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.117273 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.117573 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.117820 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.117983 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.118169 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.118314 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.118512 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.118674 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.118859 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119077 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119270 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119423 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119595 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119747 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.119981 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.120135 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.120366 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.120519 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.120683 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.120969 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.121135 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.121283 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.121551 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.121705 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.121885 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.122094 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.122246 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.122484 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.122802 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.122970 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.123118 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.123375 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.123529 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.123714 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.123920 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.124086 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.124313 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.124461 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.124607 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.124921 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.125073 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.125234 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.125464 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.125632 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.125824 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.126008 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.126203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.126543 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.126698 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.126842 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.127093 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128051 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128051 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128335 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128491 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128635 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128794 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.128939 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.129249 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.129386 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.129563 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.129718 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.129867 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.130117 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.130299 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.130483 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.130626 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.130802 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.131065 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.131226 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.131408 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.131619 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.131787 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132033 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132187 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132349 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132639 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132844 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.132998 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.133191 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.133345 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.133541 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.133740 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.133898 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.134143 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.134304 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.134501 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.134770 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.135047 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.135203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.135392 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.135596 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.135762 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136002 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136152 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136310 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136606 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136820 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.136995 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.137182 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.137333 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.137606 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.137768 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.137913 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.138202 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.138355 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.138592 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.138779 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.138931 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.139178 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.139419 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.139569 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.139791 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.139933 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.140121 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.140263 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.140432 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.140715 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.140846 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141042 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141229 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141381 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141665 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141832 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.141977 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.142241 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.142384 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.142623 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.142820 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.142998 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.143313 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.143558 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.143778 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144008 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144225 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144225 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144642 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144851 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.144851 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.145267 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.145491 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.145491 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.145906 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.146125 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.146362 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.146598 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.146598 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.146929 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147080 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147080 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147368 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147515 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147515 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147784 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.147943 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.148154 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.148318 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.148479 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.148707 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.148860 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149055 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149249 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149416 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149671 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149795 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.149976 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.150252 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.150473 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.150799 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.151044 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.151258 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.151471 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.151681 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.151905 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152112 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152323 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152323 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152724 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152935 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.152935 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.153387 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.153616 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.153849 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154058 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154058 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154502 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154661 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154661 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.154943 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.155090 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.155236 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.155704 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.155909 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156093 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156254 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156254 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156564 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156710 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156710 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.156994 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.157201 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.157363 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.157518 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.157739 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.157974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.158128 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.158349 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.158600 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.158838 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.159081 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.159233 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.159454 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.159627 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.159776 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.160120 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.160377 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.160528 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.160710 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.160861 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161020 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161269 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161424 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161646 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161795 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.161950 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.162275 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.162484 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.162631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.162897 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.163052 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.163225 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.163435 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.163580 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.163859 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.164021 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.164168 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.164434 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.164612 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.164915 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.165067 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.165211 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.165455 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.165620 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.165864 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.166012 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.166156 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.166491 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.166642 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.166807 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.167055 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.167207 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.167420 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.167578 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.167731 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168010 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168162 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168308 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168567 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168734 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.168922 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.169125 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.169275 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.169524 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.169852 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.170070 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.170236 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.170506 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.170642 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.170836 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.171114 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.171266 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.171527 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.171669 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.171813 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172090 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172241 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172396 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172676 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172840 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.172985 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.173235 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.173402 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.173628 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.173784 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.173929 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.174809 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.174960 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.175128 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.175366 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.175518 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.175769 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.175919 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.176106 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.176369 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.176537 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.176740 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.176969 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.177117 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.177380 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.177533 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.177675 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.177904 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.178143 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.178291 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.178472 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.178620 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.178894 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179076 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179222 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179469 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179635 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179795 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.179997 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.180216 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.180369 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.180539 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.180757 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.180980 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.181138 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.181283 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.181617 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.181837 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.182081 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.182304 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.182603 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.182603 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183023 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183243 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183243 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183660 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183922 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.183922 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.184333 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.184568 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.184789 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.185014 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.185014 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.185436 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.185647 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.185647 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.186044 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.186268 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.186268 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.186718 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.186951 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.187160 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.187422 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.187422 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.187886 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.188102 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.188102 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.188509 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.188720 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.188720 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.189141 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.189363 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.189573 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.190341 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.190341 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.190835 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.190986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.190986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.191335 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.191544 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.191544 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.191955 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.192164 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.192375 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.192586 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.192586 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.192940 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.193150 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.193150 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.193577 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.193785 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.193785 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.194156 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.194379 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.194641 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.194851 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.194851 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.195266 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.195477 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.195477 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.195873 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.196099 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.196324 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.196554 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.196554 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.196966 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.197185 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.197185 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.197596 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.197819 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.197819 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.198522 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.198733 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.198733 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.199176 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.199386 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.199611 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.199759 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.199759 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.200236 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.200499 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.200499 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.200786 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.201008 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.201008 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.201353 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.201580 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.201805 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.202027 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.202027 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.202517 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.202728 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.202728 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.203121 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.203347 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.203557 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.203765 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.203913 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.204127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.204127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.204552 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.204793 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.204793 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.205227 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.205465 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.205465 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.205828 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.206024 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.206233 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.206479 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.206479 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.206928 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.207135 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.207135 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.207474 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.207681 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.207681 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208092 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208312 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208312 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208599 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208750 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.208896 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209059 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209204 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209347 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209347 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209627 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209785 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.209785 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210065 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210214 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210367 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210598 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210598 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.210902 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211043 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211043 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211279 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211472 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211644 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211800 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.211800 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212078 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212237 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212394 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212550 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212703 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.212945 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.213092 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.213238 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.213541 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.213716 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.213874 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.214085 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.214237 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.214533 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.214765 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.214989 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.215202 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.215416 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.215578 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.215824 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.216056 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.216266 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.216480 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.216690 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.216690 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217099 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217324 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217324 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217726 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217932 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.217932 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.218301 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.218551 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.218551 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.218950 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.219160 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.219374 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.219656 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.219656 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220053 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220286 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220286 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220684 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220945 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.220945 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.221197 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.221506 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.221506 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.221934 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.222169 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.222379 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.222662 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.222883 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.223086 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.223086 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.223438 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.223651 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.223651 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224065 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224273 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224273 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224707 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224920 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.224920 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.225327 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.225539 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.225764 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.225986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.225986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.226379 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.226650 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.226650 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227080 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227288 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227288 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227681 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227892 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.227892 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.228304 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.228453 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.228453 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.228832 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.229042 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.229390 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.229599 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.229599 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.229997 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.230214 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.230214 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.230655 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.230867 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.230867 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.231264 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.231482 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.231644 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.231839 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.231839 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232128 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232283 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232283 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232567 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232725 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.232725 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233035 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233182 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233330 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233549 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233549 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233819 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233974 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.233974 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.234262 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.234429 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.234635 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.234826 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.234992 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.235135 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.235295 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.235504 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.235662 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.235806 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.236098 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.236254 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.236422 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.237156 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.237309 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.237608 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.237762 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.237918 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.238177 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.238324 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.238572 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.238769 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.238920 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.239178 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.239343 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.239500 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.239756 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.239910 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240100 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240295 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240449 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240704 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240853 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.240997 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.241292 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.241460 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.241599 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.241817 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.242022 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.242186 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.242392 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.242601 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.242810 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.243050 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.243216 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.243408 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.243579 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.243723 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.244010 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.244161 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.244306 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.244569 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.244730 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245071 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245225 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245371 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245515 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245652 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.245815 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.246092 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.246591 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.246820 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.246820 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.247254 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.247467 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.247467 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.247880 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.248091 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.248091 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.248513 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.248736 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.248972 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.249183 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.249183 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.249619 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.249844 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.249844 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250192 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250485 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250485 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250820 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.250986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251313 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251459 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251459 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251821 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251996 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.251996 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.252964 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253121 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253269 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253418 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253563 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253717 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.253861 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.254104 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.254254 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.254442 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.254732 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.254902 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.255155 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.255363 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.255510 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.255773 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.255934 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256091 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256301 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256461 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256681 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256829 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.256984 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.257299 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.257477 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.257622 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.257861 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.258014 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.258219 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.258396 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.258663 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.258902 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.259314 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.259465 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.259602 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.259854 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.260016 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.260211 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.260408 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.260563 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.260868 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261023 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261509 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261669 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261837 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.261981 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.262125 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.262465 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.262637 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:29:27.262768 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.263189 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.263583 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.263961 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.264350 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.264725 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.265351 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.265821 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.266016 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.266481 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.266904 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.267390 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.267921 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.268349 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.268773 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.269305 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.269757 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.270179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.270650 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.271083 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.271487 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.271891 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.272312 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.272753 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.273165 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.273612 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.274081 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.274608 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.275030 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.275440 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.275867 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.276340 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.276773 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.277240 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.277725 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.278149 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.278622 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.279040 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.279445 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.279911 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.280349 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.280781 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.281211 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.281656 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.282131 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.282610 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.283081 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.283669 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.284233 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.284739 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.285271 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.285797 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.286318 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.286891 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.287428 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.287923 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.288410 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.288898 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.289382 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.289879 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.290285 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.290732 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.291191 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.291600 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.292004 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.292432 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.292833 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.293273 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.293688 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.294090 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.294532 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.295028 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.295484 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.295889 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.296331 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.296749 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.297172 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.297604 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.298010 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.298467 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.298883 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.299823 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.300286 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.300701 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.301114 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.301538 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.301951 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.302359 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.302817 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.303306 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.303727 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.304397 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.304820 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.305232 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.305639 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.306045 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.306530 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.306957 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.307432 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.307842 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.308254 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.308660 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.309099 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.309516 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.309940 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.310376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.310825 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.311240 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.311661 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.312072 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.312592 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.313009 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.313486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.313909 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.314328 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.315410 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.315855 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.316353 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.316801 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.317222 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.317633 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.318046 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.318495 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.318918 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.319341 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.319784 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.320291 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.320746 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.321196 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.321638 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.322334 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.322809 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.323623 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.324047 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.324504 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.324948 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.325193 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Registered counter for database nova_api Jul 18 16:29:27.325494 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.325945 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.326376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.326851 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.327306 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.327752 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.328183 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.328629 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.329073 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.329509 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.329969 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.330497 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.331211 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.331679 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.332125 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.332574 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.333036 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.333483 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.333991 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.334489 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.334938 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.335376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.335829 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.336279 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.336727 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.337235 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.337657 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.338066 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.338553 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.338974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.339379 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.339811 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.340222 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.340626 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.341090 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.341529 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.341957 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.342366 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.342807 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.343221 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.343732 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.344225 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.344645 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.345091 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.345491 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.345949 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.346363 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.346876 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.347336 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.347742 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.348141 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.348573 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.348983 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.349410 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.349821 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.350230 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.350731 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.351161 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.351856 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.352286 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.352705 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.353148 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.353587 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.353992 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.354502 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.354908 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.355338 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.355749 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.356170 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.356578 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.356990 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.357429 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.357873 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.358308 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.358799 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.359239 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.359674 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.360119 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.360555 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.360997 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.361450 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.362501 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.362904 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.363290 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.363673 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.364165 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.364601 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.364982 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.365356 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.365756 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.366137 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.366594 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.366981 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.367517 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.367923 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.368298 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.368686 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.369069 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.369443 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.369841 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.370226 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.370647 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.371034 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.371408 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.371864 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.372307 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.372734 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.373155 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.373618 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.374030 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.374553 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.374999 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.375415 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.375830 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.376241 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.376643 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.377056 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.378105 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.378557 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.378973 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.379377 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.379784 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.380184 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.380585 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.380984 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.381394 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.381795 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.382195 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.382649 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.383051 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.383448 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.383868 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.384277 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.384754 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.385215 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.385650 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.386074 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.386545 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.386956 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.387456 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.387865 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.388295 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.388722 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.389141 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.389548 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.389983 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.390389 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.390836 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.391255 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.391665 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.392095 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.392505 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.392988 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.393408 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.393821 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.394243 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.394716 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.395186 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.395557 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.395925 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.396308 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.396667 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.397024 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.397378 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.397736 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.398090 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.398554 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.398919 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.399274 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.399634 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.399996 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.400431 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.400801 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.401153 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.401521 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.401888 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.402369 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.402821 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.403266 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.403687 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.404097 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.404507 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.404959 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:29:27.405327 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:29:27.442083 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.449667 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.474736 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO dbcounter [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Registered counter for database nova_api Jul 18 16:29:27.513140 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.context [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9733f778-78e8-48ae-a8ab-3c482e4cde64(cell1) {{(pid=103434) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:29:27.521227 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:29:27.524757 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:29:27.526275 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:29:27.530854 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_concurrency.lockutils [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:29:27.535504 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Registered counter for database nova_cell0 Jul 18 16:29:27.543594 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Registered counter for database nova_cell1 Jul 18 16:29:27.557450 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.559874 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.571422 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.575656 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.589780 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_db.sqlalchemy.engines [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.597941 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writer thread running {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.656477 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.context [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9733f778-78e8-48ae-a8ab-3c482e4cde64(cell1) {{(pid=103433) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:29:27.661166 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:29:27.662827 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:29:27.663649 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:29:27.665856 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:29:27.668020 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO dbcounter [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Registered counter for database nova_cell0 Jul 18 16:29:27.672251 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO dbcounter [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Registered counter for database nova_cell1 Jul 18 16:29:27.681224 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_db.sqlalchemy.engines [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.685153 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_db.sqlalchemy.engines [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.687315 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writer thread running {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.808561 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO dbcounter [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Registered counter for database nova_cell0 Jul 18 16:29:27.819508 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG oslo_db.sqlalchemy.engines [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.828808 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writer thread running {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.833628 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writer thread running {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:27.844796 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO dbcounter [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Registered counter for database nova_cell0 Jul 18 16:29:27.854954 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_db.sqlalchemy.engines [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:29:27.859816 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writer thread running {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:29:28.201042 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: WARNING keystonemiddleware.auth_token [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:29:28.202339 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:29:28.210176 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: WARNING keystonemiddleware.auth_token [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:29:28.210580 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:29:28.562845 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:29:28.564061 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: WARNING keystonemiddleware.auth_token [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:29:28.569716 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: WARNING keystonemiddleware.auth_token [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:29:28.570866 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: WARNING keystonemiddleware.auth_token [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:29:28.575450 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dabeaf9c0 pid: 103434 (default app) Jul 18 16:29:28.576600 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dabeaf9c0 pid: 103433 (default app) Jul 18 16:29:28.577793 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:29:28.579068 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-ed2305b6-a7a0-4b2d-9719-fe2366a97b5c None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002001 Jul 18 16:29:28.579498 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 788 bytes} [Mon Jul 18 16:29:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:30:59.538597 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:30:59.540815 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003449 Jul 18 16:30:59.541519 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:30:59.563373 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.565393 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell1:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.567023 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell0:SELECT=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.568440 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:00.666502 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-3166a7d8-d7df-404e-99e6-b1b5c7cde2a8 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:00.698216 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-3166a7d8-d7df-404e-99e6-b1b5c7cde2a8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.145845 Jul 18 16:31:00.699025 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 2/3] 10.222.0.77 () {60 vars in 1291 bytes} [Mon Jul 18 16:30:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:03.134385 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:03.135337 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-ba1aa375-60f8-43bf-a836-a732a41aa169 None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 18 16:31:03.136045 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 2/4] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:04.019835 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f22eacaf-bb69-498c-9848-2f29b4bee3dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:04.052678 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:31:04.052678 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: warnings.warn(msg) Jul 18 16:31:04.107734 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f22eacaf-bb69-498c-9848-2f29b4bee3dd admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.960643 Jul 18 16:31:04.109222 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 3/5] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:04.470532 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-e5415489-3f29-4fa2-8021-c0a92c8b83e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:04.474170 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:31:04.474170 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:31:04.478318 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_api:SELECT=3 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.479813 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_cell0:SELECT=3 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.480726 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_cell1:SELECT=3 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.481691 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.582899 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-e5415489-3f29-4fa2-8021-c0a92c8b83e8 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.464972 Jul 18 16:31:04.583956 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 3/6] 10.222.0.77 () {64 vars in 1335 bytes} [Mon Jul 18 16:31:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:07.315759 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f22eacaf-bb69-498c-9848-2f29b4bee3dd admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:07.317532 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f22eacaf-bb69-498c-9848-2f29b4bee3dd admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 Jul 18 16:31:07.321396 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 4/7] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:08.397823 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-aff46fdf-5722-48a1-b4a1-7d939262b773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:08.421291 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:31:08.421291 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:31:08.450249 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-aff46fdf-5722-48a1-b4a1-7d939262b773 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.120560 Jul 18 16:31:08.459806 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 4/8] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:31:08.467947 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-0b98706e-ba45-4ac9-8844-248dd964cdf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:08.470987 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:31:08.470987 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: warnings.warn(msg) Jul 18 16:31:08.529500 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-0b98706e-ba45-4ac9-8844-248dd964cdf0 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068059 Jul 18 16:31:08.530502 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 5/9] 10.222.0.77 () {64 vars in 1335 bytes} [Mon Jul 18 16:31:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:10.983024 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-aff46fdf-5722-48a1-b4a1-7d939262b773 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:10.986394 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-aff46fdf-5722-48a1-b4a1-7d939262b773 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004438 Jul 18 16:31:10.988370 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:11.479951 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-54d5ef01-0a6b-4fc6-b43e-b41c47ace221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:11.505462 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-54d5ef01-0a6b-4fc6-b43e-b41c47ace221 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510185 Jul 18 16:31:11.506366 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 6/11] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:11.519492 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f72b9d25-6809-4dee-8aa6-def112712b99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:11.550115 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f72b9d25-6809-4dee-8aa6-def112712b99 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034106 Jul 18 16:31:11.551001 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 6/12] 10.222.0.77 () {64 vars in 1335 bytes} [Mon Jul 18 16:31:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:31:14.804026 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-54d5ef01-0a6b-4fc6-b43e-b41c47ace221 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:14.805044 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-54d5ef01-0a6b-4fc6-b43e-b41c47ace221 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 18 16:31:14.805799 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 7/13] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:15.270200 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f903f218-d98f-44d0-bd8f-fee1f3c9c731 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "ram": 2048}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:15.290662 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f903f218-d98f-44d0-bd8f-fee1f3c9c731 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476604 Jul 18 16:31:15.291722 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 7/14] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:15.315936 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-60a48b66-b0ae-4fb1-a001-d67430d66f5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:15.353170 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-60a48b66-b0ae-4fb1-a001-d67430d66f5e admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045931 Jul 18 16:31:15.355438 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 8/15] 10.222.0.77 () {64 vars in 1335 bytes} [Mon Jul 18 16:31:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:17.789466 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f903f218-d98f-44d0-bd8f-fee1f3c9c731 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:17.791105 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f903f218-d98f-44d0-bd8f-fee1f3c9c731 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002418 Jul 18 16:31:17.792500 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 8/16] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:18.391624 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "disk": 20}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:18.426758 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.627172 Jul 18 16:31:18.427983 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 9/17] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:18.448331 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-eb73f378-4d9e-49ce-ba3f-e26c208517b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:18.492010 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-eb73f378-4d9e-49ce-ba3f-e26c208517b5 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048982 Jul 18 16:31:18.493300 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 9/18] 10.222.0.77 () {64 vars in 1335 bytes} [Mon Jul 18 16:31:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:21.137740 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:21.139770 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002762 Jul 18 16:31:21.143385 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 10/19] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:21.735571 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-183318a1-6c3f-4928-8bc8-f497daf81434 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:21.779855 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-183318a1-6c3f-4928-8bc8-f497daf81434 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.631210 Jul 18 16:31:21.780872 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 10/20] 10.222.0.77 () {60 vars in 1291 bytes} [Mon Jul 18 16:31:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:31:24.477492 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:24.479400 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-591727df-201a-43e5-8417-70f2d3a65555 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002694 Jul 18 16:31:24.480205 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 11/21] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:25.152785 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-b507c96b-2017-4c56-adc1-ff94666b2fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "id": "1"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:25.178580 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-b507c96b-2017-4c56-adc1-ff94666b2fda admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.687334 Jul 18 16:31:25.183058 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 11/22] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:25.202938 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f35c3edb-f872-4989-b7b8-03af4c3e6af8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:25.243729 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f35c3edb-f872-4989-b7b8-03af4c3e6af8 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049017 Jul 18 16:31:25.244572 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 12/23] 10.222.0.77 () {64 vars in 1332 bytes} [Mon Jul 18 16:31:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:28.391153 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-b507c96b-2017-4c56-adc1-ff94666b2fda admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:28.392929 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-b507c96b-2017-4c56-adc1-ff94666b2fda admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002550 Jul 18 16:31:28.393656 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 12/24] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:29.034930 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-072d1f82-21ab-47f2-8958-f7212725416e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:29.057054 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-072d1f82-21ab-47f2-8958-f7212725416e admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.653003 Jul 18 16:31:29.057639 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 13/25] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:31:29.076758 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-80af9a96-2426-4791-9746-0f786e280ccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:29.107937 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-80af9a96-2426-4791-9746-0f786e280ccd admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036249 Jul 18 16:31:29.108540 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 13/26] 10.222.0.77 () {64 vars in 1332 bytes} [Mon Jul 18 16:31:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:31:31.901860 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-072d1f82-21ab-47f2-8958-f7212725416e admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:31.903934 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-072d1f82-21ab-47f2-8958-f7212725416e admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 18 16:31:31.904363 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 14/27] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:31:32.393648 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-386ce0a0-7e9d-498c-a84f-3e19e106a498 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "disk": 40}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:32.414279 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-386ce0a0-7e9d-498c-a84f-3e19e106a498 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.502118 Jul 18 16:31:32.415057 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 14/28] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:32.428998 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-c7225bf9-2022-4d02-bb78-7885080cd525 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:32.434811 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:32.474223 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-c7225bf9-2022-4d02-bb78-7885080cd525 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049649 Jul 18 16:31:32.475016 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 15/29] 10.222.0.77 () {64 vars in 1332 bytes} [Mon Jul 18 16:31:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:31:34.924807 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-386ce0a0-7e9d-498c-a84f-3e19e106a498 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:34.926642 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-386ce0a0-7e9d-498c-a84f-3e19e106a498 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Jul 18 16:31:34.927062 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 15/30] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:35.534058 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-9637b248-b8d4-4168-9062-c77b051a52e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "disk": 80, "name": "m1.large"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:35.562735 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-9637b248-b8d4-4168-9062-c77b051a52e4 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.627866 Jul 18 16:31:35.578391 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 16/31] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:35.584092 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-4471afba-c859-40f1-b992-b4c13865002a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:35.626045 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-4471afba-c859-40f1-b992-b4c13865002a admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045989 Jul 18 16:31:35.627307 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 16/32] 10.222.0.77 () {64 vars in 1332 bytes} [Mon Jul 18 16:31:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:31:38.332692 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-9637b248-b8d4-4168-9062-c77b051a52e4 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:31:38.333703 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-9637b248-b8d4-4168-9062-c77b051a52e4 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 18 16:31:38.334113 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 17/33] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:31:39.081755 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:39.096710 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:39.131927 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.775999 Jul 18 16:31:39.131927 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 17/34] 10.222.0.77 () {64 vars in 1282 bytes} [Mon Jul 18 16:31:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:39.140011 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-79231d4b-96a7-435f-828a-de8cf7e6eb81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:31:39.190203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-79231d4b-96a7-435f-828a-de8cf7e6eb81 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048592 Jul 18 16:31:39.190203 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 18/35] 10.222.0.77 () {64 vars in 1332 bytes} [Mon Jul 18 16:31:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:32:00.909590 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:00.910646 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jul 18 16:32:00.911208 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 18/36] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:32:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:32:00.923837 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:01.527576 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-f126515b-87ac-44cf-b051-aa744201a9b9 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:01.547470 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-f126515b-87ac-44cf-b051-aa744201a9b9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.628160 Jul 18 16:32:01.548094 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 19/37] 10.222.0.77 () {60 vars in 1291 bytes} [Mon Jul 18 16:32:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:32:02.740520 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:02.741598 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-94e5a9cf-bc7f-44ef-abed-fe7cc54f0129 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 18 16:32:02.742022 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 19/38] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:32:03.363814 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-be45b24b-14e5-4cf4-aa34-4972394e6afa admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:03.370184 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-be45b24b-14e5-4cf4-aa34-4972394e6afa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-be45b24b-14e5-4cf4-aa34-4972394e6afa admin admin] Request method failure captured: Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept: application/json Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Connection: keep-alive Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Content-Length: 0 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Host: 10.222.0.77 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi1YsC45-j7NMfkcO_Z3Gf9mf9y5ceRLNlHZqvYdsUXgrBgJMN8GrVJ4DqTgk0-ZrD5B6gZstQs6J-z_aGaYxq8XX-WUKJOliUn1ZgzQR39n-jpGsmYAHRSY9xAmj7_756fVwaHt6WsQ9MLMupN-lZ1hrZ1_t9UYI1OXxwHRI1YoP_AeU Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Role: reader,admin,member Jul 18 16:32:03.374130 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Roles: reader,admin,member Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant: admin Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User: admin Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Name: admin Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: method: > Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: exception: Flavor 42 could not be found. Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: action_args: {'id': '42'} Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:03.376127 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:03.377631 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.380200 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-be45b24b-14e5-4cf4-aa34-4972394e6afa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:03.382110 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-be45b24b-14e5-4cf4-aa34-4972394e6afa admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.491730 Jul 18 16:32:03.382110 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 20/39] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Jul 18 16:32:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 493 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:32:03.392889 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-14bfa2a4-40e1-4443-b3ff-f23fefad6d16 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:03.434799 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-14bfa2a4-40e1-4443-b3ff-f23fefad6d16 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.048223 Jul 18 16:32:03.435806 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 20/40] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:32:03.453509 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-975ef927-e060-4177-bf1f-32892f4548b1 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:03.486023 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-975ef927-e060-4177-bf1f-32892f4548b1 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039284 Jul 18 16:32:03.486533 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 21/41] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:32:03.496535 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-7f5d4ea0-9807-4320-9d4b-68699375a8c2 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:03.503199 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.wsgi [None req-7f5d4ea0-9807-4320-9d4b-68699375a8c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-7f5d4ea0-9807-4320-9d4b-68699375a8c2 admin admin] Request method failure captured: Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept: application/json Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept-Encoding: gzip, deflate Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Connection: keep-alive Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Content-Length: 0 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Host: 10.222.0.77 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-System-Scope: None Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: User-Agent: python-novaclient Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Auth-Token: gAAAAABi1YsC45-j7NMfkcO_Z3Gf9mf9y5ceRLNlHZqvYdsUXgrBgJMN8GrVJ4DqTgk0-ZrD5B6gZstQs6J-z_aGaYxq8XX-WUKJOliUn1ZgzQR39n-jpGsmYAHRSY9xAmj7_756fVwaHt6WsQ9MLMupN-lZ1hrZ1_t9UYI1OXxwHRI1YoP_AeU Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Id: None Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Name: None Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Identity-Status: Confirmed Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Is-Admin-Project: True Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Id: default Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Name: Default Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Name: admin Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Role: reader,admin,member Jul 18 16:32:03.506804 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Roles: reader,admin,member Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant: admin Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Name: admin Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User: admin Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Id: default Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Name: Default Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Name: admin Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: method: > Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: exception: Flavor 42 could not be found. Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: action_args: {'id': '42'} Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:03.509345 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:03.510977 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:03.513060 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-7f5d4ea0-9807-4320-9d4b-68699375a8c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:03.515106 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-7f5d4ea0-9807-4320-9d4b-68699375a8c2 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015602 Jul 18 16:32:03.515106 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 21/42] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Jul 18 16:32:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:32:04.656842 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-975ef927-e060-4177-bf1f-32892f4548b1 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:04.657860 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-975ef927-e060-4177-bf1f-32892f4548b1 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 18 16:32:04.658268 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 22/43] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:32:05.289868 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-750db738-487b-4b29-89dc-a0bd6770f0e8 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:05.297253 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.wsgi [None req-750db738-487b-4b29-89dc-a0bd6770f0e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-750db738-487b-4b29-89dc-a0bd6770f0e8 admin admin] Request method failure captured: Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept: application/json Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept-Encoding: gzip, deflate Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Connection: keep-alive Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Content-Length: 0 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Host: 10.222.0.77 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-System-Scope: None Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: User-Agent: python-novaclient Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Auth-Token: gAAAAABi1YsEhaZdovhGwisygRiA1P0yUcfXPIY8fdOQW9e1944VshdWRKyVVEAYYJzh-rmz9dfPx4IRYfS97-Eo2E2gXIIj7hSfJRymvmzmAY3vdJ7HUYSv8S8QSRRhF5RpKXzsyiRaS4CwSCHGDZBgulhmmQNh70aDnGpzS5nSnF6yyZfJFaw Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Id: None Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Name: None Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Identity-Status: Confirmed Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Is-Admin-Project: True Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Id: default Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Name: Default Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Name: admin Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Role: reader,admin,member Jul 18 16:32:05.298974 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Roles: reader,admin,member Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant: admin Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Name: admin Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User: admin Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Id: default Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Name: Default Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Name: admin Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: method: > Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: exception: Flavor 84 could not be found. Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: action_args: {'id': '84'} Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:05.301320 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:05.302179 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.303741 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-750db738-487b-4b29-89dc-a0bd6770f0e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:05.304811 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-750db738-487b-4b29-89dc-a0bd6770f0e8 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.498716 Jul 18 16:32:05.304811 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 22/44] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Jul 18 16:32:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:32:05.313748 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-d10981a5-dc6e-4396-bc1d-7cd2b552cbee admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:05.328481 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-d10981a5-dc6e-4396-bc1d-7cd2b552cbee admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018241 Jul 18 16:32:05.329069 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 23/45] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:32:05.339829 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-3bfccf80-a5b4-4839-b380-13566eca3a91 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:05.356070 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-3bfccf80-a5b4-4839-b380-13566eca3a91 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020334 Jul 18 16:32:05.356648 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 23/46] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:32:05.366925 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-448a0fe8-78e8-4da0-b7f7-96f1256889f2 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:05.373314 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-448a0fe8-78e8-4da0-b7f7-96f1256889f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-448a0fe8-78e8-4da0-b7f7-96f1256889f2 admin admin] Request method failure captured: Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept: application/json Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Connection: keep-alive Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Content-Length: 0 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Host: 10.222.0.77 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi1YsEhaZdovhGwisygRiA1P0yUcfXPIY8fdOQW9e1944VshdWRKyVVEAYYJzh-rmz9dfPx4IRYfS97-Eo2E2gXIIj7hSfJRymvmzmAY3vdJ7HUYSv8S8QSRRhF5RpKXzsyiRaS4CwSCHGDZBgulhmmQNh70aDnGpzS5nSnF6yyZfJFaw Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Role: reader,admin,member Jul 18 16:32:05.374890 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Roles: reader,admin,member Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant: admin Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User: admin Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Name: admin Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: method: > Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: exception: Flavor 84 could not be found. Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: action_args: {'id': '84'} Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:05.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:05.378869 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:05.380928 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-448a0fe8-78e8-4da0-b7f7-96f1256889f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:05.382873 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-448a0fe8-78e8-4da0-b7f7-96f1256889f2 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013156 Jul 18 16:32:05.382873 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 24/47] 10.222.0.77 () {60 vars in 1190 bytes} [Mon Jul 18 16:32:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:32:06.451189 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-3bfccf80-a5b4-4839-b380-13566eca3a91 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:06.452435 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-3bfccf80-a5b4-4839-b380-13566eca3a91 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Jul 18 16:32:06.452925 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 24/48] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:32:07.084905 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-05084b10-ca04-4179-a74c-cb98862f697c admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:07.091881 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.wsgi [None req-05084b10-ca04-4179-a74c-cb98862f697c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-05084b10-ca04-4179-a74c-cb98862f697c admin admin] Request method failure captured: Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept: application/json Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Accept-Encoding: gzip, deflate Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Connection: keep-alive Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Content-Length: 0 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Host: 10.222.0.77 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Openstack-System-Scope: None Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: User-Agent: python-novaclient Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Auth-Token: gAAAAABi1YsGlHhbA-uOqXGCX8zrP1vNn4F0v_hDW9RIX9NjGu7DX9mwGD_yXYnA-kzXHYA4U4cLJjWKaGHRD0WV0fMqgX91WplmHo9SVwfA-8GP-fqJLZxwaGri2VKN7D6K-2dTFXj7d5W6fcjioVcXrX8f1ZkTooUShVkvAXRIj39e2dwzDSw Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Id: None Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Domain-Name: None Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Identity-Status: Confirmed Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Is-Admin-Project: True Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Id: default Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Domain-Name: Default Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Project-Name: admin Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Role: reader,admin,member Jul 18 16:32:07.093446 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Roles: reader,admin,member Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant: admin Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-Tenant-Name: admin Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User: admin Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Id: default Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Domain-Name: Default Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: X-User-Name: admin Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: method: > Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: exception: Flavor 451 could not be found. Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: action_args: {'id': '451'} Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:07.095784 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:07.097685 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.100229 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-05084b10-ca04-4179-a74c-cb98862f697c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:07.102879 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-05084b10-ca04-4179-a74c-cb98862f697c admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.496495 Jul 18 16:32:07.102879 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 25/49] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:32:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 16:32:07.107693 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-2c92fa72-26ba-4e9a-913a-b44aa4205ae3 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:07.122091 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-2c92fa72-26ba-4e9a-913a-b44aa4205ae3 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017986 Jul 18 16:32:07.123017 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 25/50] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:32:07.136832 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:07.153449 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020815 Jul 18 16:32:07.154028 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 26/51] 10.222.0.77 () {60 vars in 1210 bytes} [Mon Jul 18 16:32:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:32:07.170665 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-484b4a1c-335c-4eed-860a-c6a56c7dd9b9 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:07.180508 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.wsgi [None req-484b4a1c-335c-4eed-860a-c6a56c7dd9b9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-484b4a1c-335c-4eed-860a-c6a56c7dd9b9 admin admin] Request method failure captured: Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept: application/json Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Accept-Encoding: gzip, deflate Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Connection: keep-alive Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Content-Length: 0 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Host: 10.222.0.77 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-Api-Version: compute 2.90 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Openstack-System-Scope: None Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: User-Agent: python-novaclient Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Auth-Token: gAAAAABi1YsGlHhbA-uOqXGCX8zrP1vNn4F0v_hDW9RIX9NjGu7DX9mwGD_yXYnA-kzXHYA4U4cLJjWKaGHRD0WV0fMqgX91WplmHo9SVwfA-8GP-fqJLZxwaGri2VKN7D6K-2dTFXj7d5W6fcjioVcXrX8f1ZkTooUShVkvAXRIj39e2dwzDSw Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Id: None Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Domain-Name: None Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Identity-Status: Confirmed Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Is-Admin-Project: True Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Id: default Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Domain-Name: Default Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Project-Name: admin Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Role: reader,admin,member Jul 18 16:32:07.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Roles: reader,admin,member Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_c66249a1b75d4939b69e5011863c8709", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/c66249a1b75d4939b69e5011863c8709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant: admin Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Id: c66249a1b75d4939b69e5011863c8709 Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-Tenant-Name: admin Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User: admin Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Id: default Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Domain-Name: Default Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Id: cf4ea7b7962d4647b8de9301728f33d1 Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: X-User-Name: admin Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: method: > Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: exception: Flavor 451 could not be found. Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: action_args: {'id': '451'} Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:32:07.185900 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:07.187470 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: ERROR nova.api.openstack.wsgi Jul 18 16:32:07.190064 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-484b4a1c-335c-4eed-860a-c6a56c7dd9b9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:32:07.192079 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-484b4a1c-335c-4eed-860a-c6a56c7dd9b9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.022328 Jul 18 16:32:07.192079 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 26/52] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:32:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:32:08.272979 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:08.274600 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Jul 18 16:32:08.275322 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 27/53] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:32:09.041898 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f289a0ae-72f2-4473-a7ea-915b659bea85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:32:09.064029 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f289a0ae-72f2-4473-a7ea-915b659bea85 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.519976 Jul 18 16:32:09.064818 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 27/54] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Jul 18 16:32:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:32:10.129355 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:10.131270 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002679 Jul 18 16:32:10.132032 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 28/55] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:32:10.868781 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-cdeb0beb-84e4-415a-b57d-89e4095fc08c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:32:10.889743 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-cdeb0beb-84e4-415a-b57d-89e4095fc08c admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.498333 Jul 18 16:32:10.890308 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 28/56] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Jul 18 16:32:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:32:11.944761 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:11.945786 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 18 16:32:11.946202 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 29/57] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:32:12.559886 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f30454fa-e53a-46f0-bfb3-2d85aa7a7425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:32:12.582756 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f30454fa-e53a-46f0-bfb3-2d85aa7a7425 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.492171 Jul 18 16:32:12.583367 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 29/58] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Jul 18 16:32:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:32:13.700635 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:13.701573 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 18 16:32:13.701986 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 30/59] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:32:14.309389 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-cac1cfbf-f216-4de6-91c0-b4843b879964 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:32:14.330091 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-cac1cfbf-f216-4de6-91c0-b4843b879964 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.484699 Jul 18 16:32:14.330685 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 30/60] 10.222.0.77 () {64 vars in 1235 bytes} [Mon Jul 18 16:32:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:32:15.444048 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:15.445087 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jul 18 16:32:15.445507 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 31/61] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:32:16.058722 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-f90d1c17-4b44-41d6-b631-6fef54f2b0e4 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:32:16.098021 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-f90d1c17-4b44-41d6-b631-6fef54f2b0e4 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.507260 Jul 18 16:32:16.099088 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 31/62] 10.222.0.77 () {60 vars in 1202 bytes} [Mon Jul 18 16:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:33:14.499204 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:14.500881 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-1b047d55-2a4b-4ab2-91c7-b9c0497a7803 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Jul 18 16:33:14.501408 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 32/63] 10.222.0.77 () {54 vars in 930 bytes} [Mon Jul 18 16:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:33:14.513744 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:15.021216 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-55064d2c-dff9-48db-a0f9-006fb9d1e9f9 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:15.041527 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-55064d2c-dff9-48db-a0f9-006fb9d1e9f9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.532500 Jul 18 16:33:15.042380 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 32/64] 10.222.0.77 () {60 vars in 1291 bytes} [Mon Jul 18 16:33:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:33:15.063626 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG dbcounter [-] [103434] Writing DB stats nova_api:SELECT=14 {{(pid=103434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:15.068138 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-4b869636-727a-44f4-9903-5dd9be636662 admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:15.076970 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-4b869636-727a-44f4-9903-5dd9be636662 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014656 Jul 18 16:33:15.077456 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 33/65] 10.222.0.77 () {60 vars in 1282 bytes} [Mon Jul 18 16:33:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:33:15.090390 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-e753e68b-c520-4395-a707-3a703c57fdc4 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:15.098989 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-e753e68b-c520-4395-a707-3a703c57fdc4 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012341 Jul 18 16:33:15.099730 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 33/66] 10.222.0.77 () {60 vars in 1285 bytes} [Mon Jul 18 16:33:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:33:15.113332 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:15.122064 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012723 Jul 18 16:33:15.122678 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 34/67] 10.222.0.77 () {60 vars in 1285 bytes} [Mon Jul 18 16:33:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:33:15.135414 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-9e7d16a6-1426-419a-8fbe-d359bf678f45 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:33:15.144021 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-9e7d16a6-1426-419a-8fbe-d359bf678f45 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012348 Jul 18 16:33:15.144659 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 34/68] 10.222.0.77 () {60 vars in 1282 bytes} [Mon Jul 18 16:33:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:36:51.695384 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:36:51.696482 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 18 16:36:51.697056 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 35/69] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:36:51.845691 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_api:SELECT=6 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:36:52.016902 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:36:52.018159 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:36:52.018159 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:36:52.019528 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:52.020008 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:52.020937 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:52.021376 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:52.059183 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-dfcc98cd-8272-4300-9552-9088a6ddbd97 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.214957 Jul 18 16:36:52.059774 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 35/70] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:36:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:36:53.116458 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:36:53.118131 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002386 Jul 18 16:36:53.119172 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 36/71] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:36:53.468260 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:36:53.469677 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:36:53.469677 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:36:53.471146 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:53.471640 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:53.472501 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:53.472989 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:53.493752 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-0abc573c-648b-4df4-8a43-7ab16001bfc2 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.110386 Jul 18 16:36:53.494341 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 36/72] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:36:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:37:04.780475 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:04.781814 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Jul 18 16:37:04.782337 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 37/73] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:37:04.932784 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_cell0:SELECT=4 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:04.933603 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_cell1:SELECT=4 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:04.934434 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG dbcounter [-] [103433] Writing DB stats nova_api:SELECT=8 {{(pid=103433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:04.990527 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:04.991787 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:04.991787 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:37:04.993172 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:37:04.993660 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:37:04.994546 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:37:04.995023 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:37:05.023653 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-c39e8334-3038-4301-831e-ef718f0f08e6 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095697 Jul 18 16:37:05.024274 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 37/74] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:37:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:37:05.894400 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: DEBUG nova.api.openstack.wsgi [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] Calling method '>' {{(pid=103434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:05.895787 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: INFO nova.api.openstack.requestlog [None req-8c2f0285-c489-4d16-980e-530e7350cdca admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001969 Jul 18 16:37:05.896321 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: [pid: 103434|app: 0|req: 38/75] 10.222.0.77 () {56 vars in 1074 bytes} [Mon Jul 18 16:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:37:06.104015 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG nova.api.openstack.wsgi [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] Calling method '>' {{(pid=103433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:06.105279 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:06.105279 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: warnings.warn(msg) Jul 18 16:37:06.106646 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:37:06.107139 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:37:06.107958 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:37:06.108395 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: DEBUG oslo_concurrency.lockutils [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:37:06.132213 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: INFO nova.api.openstack.requestlog [None req-1bf9d87e-99f1-4c2c-a893-1f1780a7a26d admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089809 Jul 18 16:37:06.132811 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: [pid: 103433|app: 0|req: 38/76] 10.222.0.77 () {60 vars in 1193 bytes} [Mon Jul 18 16:37:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:38:06.675730 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: Mon Jul 18 16:38:06 2022 - graceful shutdown triggered... Jul 18 16:38:06.676291 dv-cinder-837543-6-iscsi devstack@n-api.service[103434]: Gracefully killing worker 2 (pid: 103434)... Jul 18 16:38:06.675795 dv-cinder-837543-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 16:38:06.677100 dv-cinder-837543-6-iscsi devstack@n-api.service[103433]: Gracefully killing worker 1 (pid: 103433)... Jul 18 16:38:07.676920 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: worker 1 buried after 1 seconds Jul 18 16:38:07.676920 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: worker 2 buried after 1 seconds Jul 18 16:38:07.676920 dv-cinder-837543-6-iscsi devstack@n-api.service[103420]: goodbye to uWSGI. Jul 18 16:38:07.678786 dv-cinder-837543-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 16:38:07.679589 dv-cinder-837543-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 16:38:07.683312 dv-cinder-837543-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:38:07.699781 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:38:07 2022] *** Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: nodename: dv-cinder-837543-6-iscsi Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: machine: x86_64 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: clock source: unix Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: pcre jit disabled Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: detected number of CPU cores: 4 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: current working directory: / Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: your processes number limit is 47680 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: your memory page size is 4096 bytes Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: detected max file descriptor number: 2048 Jul 18 16:38:07.702892 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: lock engine: pthread robust mutexes Jul 18 16:38:07.705190 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: thunder lock: enabled Jul 18 16:38:07.705190 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:38:07.705190 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:38:07.749253 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: Python main interpreter initialized at 0x55918544b9c0 Jul 18 16:38:07.749253 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: python threads support enabled Jul 18 16:38:07.749253 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: your server socket listen backlog is limited to 100 connections Jul 18 16:38:07.749253 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:38:07.749831 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:38:07.749831 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: *** Operational MODE: preforking *** Jul 18 16:38:07.750043 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:38:07.750043 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: spawned uWSGI master process (pid: 129654) Jul 18 16:38:07.750279 dv-cinder-837543-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:38:07.750527 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: spawned uWSGI worker 1 (pid: 129671, cores: 1) Jul 18 16:38:07.750987 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: spawned uWSGI worker 2 (pid: 129672, cores: 1) Jul 18 16:38:07.750987 dv-cinder-837543-6-iscsi devstack@n-api.service[129654]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:38:08.465401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:38:08.467238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:38:09.694285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:38:09.694285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: from cryptography.utils import int_from_bytes Jul 18 16:38:09.695517 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:38:09.695517 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: from cryptography.utils import int_from_bytes Jul 18 16:38:09.824629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:38:09.824629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: from cryptography.utils import int_from_bytes Jul 18 16:38:09.825602 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:38:09.825602 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: from cryptography.utils import int_from_bytes Jul 18 16:38:12.124911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:38:12.125759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:38:12.125759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:38:12.126362 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:38:12.126362 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:38:12.126864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.127123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.127536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.127892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.128253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.128573 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.128902 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.129228 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.129563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.129840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.130275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.130668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-6-iscsi {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.131046 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.131380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.131674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.132005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.132402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.132732 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.133052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.133579 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.136678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-6-iscsi {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.139286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.142097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.144161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.147893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.149523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.151332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.153907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.155410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157607 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.157682 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.158002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.158316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.158649 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.158961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.159277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.159624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.159900 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.160274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.160743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.161096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.161409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.161725 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.162057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.162372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.162711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.163107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.163444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.163783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.164113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.164429 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.164740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.165062 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.165374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.165687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.166020 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.166854 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.167327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.167669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.168001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.168316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.168627 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.168935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.169242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.169562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.169852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.170164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.170493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.170823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.171151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.171464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.171772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.172077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.172398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.172742 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.173076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.173421 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.173741 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.174074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.174448 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.174756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.175073 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.175394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.175723 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.176037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.176351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.176695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.176980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.177302 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.177634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.177951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.178270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.178631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.178938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.179263 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.179585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.179909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.180214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.180569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.180920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.181242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.181566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.181967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.182801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.183113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.183424 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.184017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.184364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.184710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.185037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.185353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.185668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.185981 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.186298 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.186646 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.186996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.187322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.187638 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.187952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.188270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.188585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.188903 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.189215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.189527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.189834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.190137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.190484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.190796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.191122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.191461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.191768 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.192105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.192412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.192725 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.193037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.193348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.193654 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.193968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.194280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.194617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.194946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.195255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.195563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.195892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.196197 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.196502 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.196819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.197130 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.197443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.197802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.198114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.198461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.198780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.199239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.199420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.199828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.200051 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.200383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.200716 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.201057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.201327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.201641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.201946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.202250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.202579 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.202890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.203193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.203502 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.203799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.204100 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.204404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.204731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.205048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.205346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.205651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.205954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.206298 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.206640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.206987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.207322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.207645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.207967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.208280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.208596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.208906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.209237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.209526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.209995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.210173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.210483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.210805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.211118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.211478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.211754 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.212078 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.212383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.212697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.213040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.213420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.213748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.214070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.214381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.214718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.215029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.215823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.215823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.216171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.216334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.216557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.216879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.217187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.217513 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.217824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.218206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.218470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.218778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.219114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.219476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.219918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.220234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.220642 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.220967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.221302 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.221700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.221921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.222237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.222600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.223003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.223318 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.223632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.223938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.224260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.224605 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.224915 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.225226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.225542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.225875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.226188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.226538 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.226863 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.227173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.227554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.227802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.228021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:38:12.228528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.228694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:38:12.229395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.229395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.229713 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:38:12.229860 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.230020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:38:12.230177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.230324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:38:12.230974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.231145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.231295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.231442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.231609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.231787 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.231939 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.232629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.232793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.232954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.233102 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.233315 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.233523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.233685 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.233832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.233986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.234257 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.234495 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.234800 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.234953 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.235108 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.235256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.235411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.235566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-6-iscsi {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.235713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.235874 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.236024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.236179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.236417 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.236578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.236725 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.236870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.237015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.237167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.237323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.237476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.237476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.238064 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.238064 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.238377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.238593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.238754 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.238930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.239695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.239695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.240008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.240008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.240287 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.240443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.240666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.240873 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.241033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.241180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.241339 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.241486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.241631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.241790 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.241936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.242089 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.242868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.243037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.243195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-6-iscsi {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.243351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.243498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.243645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.243808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.243975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.244121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.244455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.244455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.245416 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.245574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.245731 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.245878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.246043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.246319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.246543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.246706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.246873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.247028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.247806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.248225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.248225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.248523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.248685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.248842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.248989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.249151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.249151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.249449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.249605 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.249760 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.249907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.250060 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.250233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.250557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.250557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.250860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.251006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.251151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.251321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.251478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.251642 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.251788 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.251934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.252080 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.252233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.252408 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.253132 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.253300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.253456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.253612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.253774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.253930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.253930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.254233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.254233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.254738 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.254902 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.255050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.255212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.255527 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.255692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.255853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.256007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.256155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.256314 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.256467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.256613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.256766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.256921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.257075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.257229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.257375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.257528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.257683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.257683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.257968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.257968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.258608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.258608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.258978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.259127 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.259282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.259436 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.259582 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.259582 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.259919 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.259919 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.260269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.260424 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.260578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.260578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.260933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.261095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.261252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.261410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.261556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.261769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.261926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.262081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.262235 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.262382 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.262586 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.263356 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.263514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.263670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.263817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.263970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.264122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.264278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.264433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.264582 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.264857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.265018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.265180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.265327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.265511 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.266494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.266659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.266807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.266973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.267129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.267284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.267438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.267592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.267750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.267907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.268061 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.268237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.268531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.268931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.269095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.269252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.269399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.269545 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.269690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.269837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.270063 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.270220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.270366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.270570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.270729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.270889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.271050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.271205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.271359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.271512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.271658 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.271813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.271921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.272065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.272157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.272244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.272329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.272415 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.272515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.272611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.272706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.272812 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.272917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.273272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.273536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.273634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.273768 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.273870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.273966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.274053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.274138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.274230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.274373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.274497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.274585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.274671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.274769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.274872 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.274969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.275063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.275157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.275252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.275347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.275442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.275541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.275660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.275759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.275845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.275930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.276024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.276124 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.276124 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.276291 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.276376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.276743 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.276847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.276934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.277126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.277299 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.277493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.277771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.277949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.278046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.278141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.278228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.278308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.278395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.278554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.278653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.278748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.278843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.279237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279346 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:38:12.279444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279829 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.279913 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280376 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280376 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280654 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280739 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.280916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281004 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281103 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281339 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281492 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281573 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281647 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.281954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282100 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282243 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282330 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282435 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282600 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.282928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.283976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.284868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285142 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285602 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.285996 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.286661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287132 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.287939 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288207 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.288993 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.289927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.290031 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.290229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.290313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.291162 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.291786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.291867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.291955 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292618 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.292955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.293123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.293283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.293448 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.293644 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.293832 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.294862 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295221 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295674 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.295849 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296011 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.296867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.297923 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.298890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299054 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299342 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299809 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.299972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.300114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.300290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.300658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.300833 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.300999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.301149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.301252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.301594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.301765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.301916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.302925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.303238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.303412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.303563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.303711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.303853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.304021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.304166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.304375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.304522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.304670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.305808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.306105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.306268 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.306458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.306754 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.306983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.307683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.307894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.308067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.308229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.308391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.308533 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.308930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309080 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.309987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310310 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310769 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.310898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.311967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312232 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312624 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312762 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.312899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313035 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.313822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.314006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.314146 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.314589 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.314741 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.314901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.315036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.315182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.315569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.315744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.316187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.316552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.316731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.316731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317668 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.317805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318543 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.318750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319100 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.319962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320089 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.320781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321751 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.321900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.322182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.322348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.322665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.322810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.322951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323572 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.323893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.324865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325027 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325356 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.325851 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.326035 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.326243 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.326464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.326644 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.326878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327358 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327506 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.327885 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328406 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.328867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329521 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329833 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.329984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.330148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.330313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.330575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.330727 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.330871 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.331040 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.331186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.331332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.331591 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.331978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332787 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.332936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.333677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.334779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335723 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.335884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336036 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336300 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336431 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.336829 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.337904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.338261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.338543 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.338723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.338876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339223 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.339849 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340454 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340609 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.340804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.341921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342734 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.342986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.343839 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344300 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344427 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.344998 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345158 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345490 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345642 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345788 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.345917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.346093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.346298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.346555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.346758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.346895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347343 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347596 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.347893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348043 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.348956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349089 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349362 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349511 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.349979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350436 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.350932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351293 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.351994 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352607 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.352963 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.353111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.353258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.353415 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.353578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.354275 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.354450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.354682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.354850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355158 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355416 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355573 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.355874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356405 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.356749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357033 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357689 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.357985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.358159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.358310 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.358482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.358630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.358848 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359010 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359474 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.359926 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360094 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360550 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.360872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361232 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361533 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.361856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362009 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.362916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.363846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364475 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364788 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.364936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.365998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.366161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.366315 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.367487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.367645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.367816 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.367963 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.368889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.369101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.369261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370080 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370232 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.370901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371646 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.371972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372120 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.372931 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373388 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.373996 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.374156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.374319 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.374516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.374667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.374814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375026 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375194 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375507 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375809 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.375968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.376112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.376269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.376405 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.376609 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.376813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377432 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.377868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.378960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379113 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379257 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.379870 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380198 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380654 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.380934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381091 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381379 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.381906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382072 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382777 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.382940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383268 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.383897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384060 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384557 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.384863 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385652 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.385965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.386124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.386278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.386451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.386621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.386621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.387902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.388872 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389004 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.389896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.390961 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391264 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391760 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.391943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392103 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.392880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393352 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.393990 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.394151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.394306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.394560 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.394734 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.394909 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.395972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396120 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396279 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396432 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396731 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.396955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.397111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.397309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.397472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.397677 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.397889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398046 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398336 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.398673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.399012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.400212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.401350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.402494 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.402494 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.402494 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.402972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.402972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.403233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.403536 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.403864 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.404174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.404481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.404788 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.405100 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.405452 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.405770 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.406102 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.406459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.406799 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.407168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.407455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.407791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.408111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.408434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.408763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.409074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.409384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.409699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.410012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.410324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.410663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.410977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.411284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.411590 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.411896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.412231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.412543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.412867 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.413183 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.413491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.413802 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.414109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.414492 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.414810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.415159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.415487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.415815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.416152 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.417030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.417356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.417681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.418053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.418326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.418679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.419001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.419327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.419645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.419970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.420292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.420617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.420931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.421526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.421868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.422188 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.422545 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.422867 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.423241 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.423561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.423879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.424197 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.424512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.424827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.425178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.425508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.425841 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.426188 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.426547 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.426871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.427190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.427509 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.427884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.428205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.428518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.428836 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.429159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.429481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.429800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.430139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.430473 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.430793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.431112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.431426 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.431749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.432639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.432984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.433327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.433910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.434233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.434583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.434908 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.435501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.435823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.436166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.436498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.436827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.437153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.437479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.437812 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.438123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.438454 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.438779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.439093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.439405 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.439740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.440056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.440369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.440699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.441013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.441633 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.441993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.442332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.442838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.443029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.443349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.443662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.443993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.444310 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.444625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.444947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.445262 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.445574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.445887 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.446207 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.446551 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.446859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.447177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.447521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.447861 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.448174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.448512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.448789 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.449113 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.449426 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.449734 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.450050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.450361 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.450718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.451028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.451341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.451649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.451969 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.452280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.452594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.452954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.453293 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.453601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.453915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.454255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.454588 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.454918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.455240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.455555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.455911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.456230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.456831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.457170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.457500 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.457845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.458179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.458519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.458837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.459145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.459475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.459821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.460106 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.460420 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.460736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.461050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.461365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.461677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.461989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.462299 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.462739 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.463000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.463407 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.463722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.464073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.464462 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.464792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.465114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.465436 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.465758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.466075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.466388 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.466729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.467064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.467364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.467701 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.468023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.468332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.468783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.469087 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.469413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.469737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.470050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.470475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.470808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.471125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.471509 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.471842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.472177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.472566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.472901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.473229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.473540 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.473857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.474164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.474505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.474832 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.475143 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.475450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.475757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.476070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.476376 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.476685 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.476990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.477298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.477730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.478039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.478396 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.478684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.479518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.479824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.480133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.480444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.480752 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.481060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.481368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.481699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.482005 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.482354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.482737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.483055 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.483382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.483703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.484025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.484342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.484669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.484991 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.485313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.485635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.485973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.486280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.486628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.486945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.487263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.487613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.487926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.488271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.488601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.488903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.489236 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.489578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.489911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.490229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.490576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.490907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.491224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.491549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.491860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.492178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.492491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.492813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.493125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.493442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.493800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.494125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.495034 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.495366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.495679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.496007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.496336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.496700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.497018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.497368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.497702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.498020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.498337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.498677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:38:12.498931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:38:12.563429 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO dbcounter [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Registered counter for database nova_api Jul 18 16:38:12.585693 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_db.sqlalchemy.engines [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.594346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writer thread running {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.658816 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO dbcounter [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Registered counter for database nova_api Jul 18 16:38:12.675814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.context [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9733f778-78e8-48ae-a8ab-3c482e4cde64(cell1) {{(pid=129672) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:38:12.681918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:38:12.682321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.684145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:38:12.685462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:38:12.688529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:38:12.690734 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO dbcounter [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Registered counter for database nova_cell0 Jul 18 16:38:12.691191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writer thread running {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.696737 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO dbcounter [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Registered counter for database nova_cell1 Jul 18 16:38:12.707246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_db.sqlalchemy.engines [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.709422 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_db.sqlalchemy.engines [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.717218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writer thread running {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.719045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writer thread running {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.758571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.context [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9733f778-78e8-48ae-a8ab-3c482e4cde64(cell1) {{(pid=129671) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:38:12.763134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:38:12.765230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:38:12.766195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:38:12.768585 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:38:12.770943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO dbcounter [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Registered counter for database nova_cell0 Jul 18 16:38:12.776488 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO dbcounter [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Registered counter for database nova_cell1 Jul 18 16:38:12.789234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.792727 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.802387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writer thread running {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.806168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writer thread running {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:12.872039 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO dbcounter [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Registered counter for database nova_cell0 Jul 18 16:38:12.883171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_db.sqlalchemy.engines [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:12.888801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writer thread running {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:13.101165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO dbcounter [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Registered counter for database nova_cell0 Jul 18 16:38:13.113144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:38:13.123497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writer thread running {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:38:13.232820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: WARNING keystonemiddleware.auth_token [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:38:13.240486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: WARNING keystonemiddleware.auth_token [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:38:13.595702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: WARNING keystonemiddleware.auth_token [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:38:13.601918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: WARNING keystonemiddleware.auth_token [None req-a393f93c-bb93-420e-99fe-758a65d04aac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:38:13.607704 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55918544b9c0 pid: 129672 (default app) Jul 18 16:38:13.755841 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: WARNING keystonemiddleware.auth_token [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:38:13.769761 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: WARNING keystonemiddleware.auth_token [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:38:14.392388 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: WARNING keystonemiddleware.auth_token [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:38:14.404803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: WARNING keystonemiddleware.auth_token [None req-f9ef218d-86b3-49be-aa71-e632f6a1d061 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:38:14.414748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55918544b9c0 pid: 129671 (default app) Jul 18 16:39:00.735465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:00.737642 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:00.739271 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:00.740755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:03.146980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2a94bc26-5041-40d8-9c3b-1d11663bdda6 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Action: 'create', calling method: .version_select at 0x7fc3a3e938b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1661224929", "metadata": {"Type": "work"}}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:05.870576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:05.872021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:05.873657 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:05.878626 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:05.955749 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2a94bc26-5041-40d8-9c3b-1d11663bdda6 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.231537 Jul 18 16:39:05.964206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 18 16:39:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5235 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:39:05.971515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8fb9ab60-d9bb-434f-9cb4-21cb2ee59e72 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d5f700>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:06.142382 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8fb9ab60-d9bb-434f-9cb4-21cb2ee59e72 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 200 len: 353 microversion: 2.1 time: 0.176303 Jul 18 16:39:06.147641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 2/2] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:05 2022] GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:39:06.449550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-059f8212-242d-4dc7-af73-16a88711ee1f tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3e983a0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:07.156750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-33e27ccf-cf27-41eb-aa6f-abbe30cfdfaa tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d5f820>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:07.251297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-059f8212-242d-4dc7-af73-16a88711ee1f tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/19cda8f6-94c0-42bf-a8f1-7090a738b6d9" status: 200 len: 351 microversion: 2.1 time: 1.386506 Jul 18 16:39:07.252298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:05 2022] GET /compute/v2.1/os-volumes/19cda8f6-94c0-42bf-a8f1-7090a738b6d9 => generated 351 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:39:07.404377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-33e27ccf-cf27-41eb-aa6f-abbe30cfdfaa tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 200 len: 354 microversion: 2.1 time: 0.252509 Jul 18 16:39:07.405703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:07 2022] GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:07.422255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9b9355ce-54f2-4a1c-a92d-7f810fa6e7dc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d5d5e0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:07.671835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9b9355ce-54f2-4a1c-a92d-7f810fa6e7dc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 200 len: 354 microversion: 2.1 time: 0.257111 Jul 18 16:39:07.673250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 2/5] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:07 2022] GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 354 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:07.699328 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d1015ba0-feb5-4c3d-aade-00bebcc0d8ff tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d5fe50>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:08.308315 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d1015ba0-feb5-4c3d-aade-00bebcc0d8ff tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 202 len: 0 microversion: 2.1 time: 0.617660 Jul 18 16:39:08.309333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 4/6] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:39:07 2022] DELETE /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:39:08.317749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-068c96e7-b9ef-425d-a2b7-1da780aba6c3 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d5dd30>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:08.493971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-068c96e7-b9ef-425d-a2b7-1da780aba6c3 tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 200 len: 353 microversion: 2.1 time: 0.180049 Jul 18 16:39:08.495062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:08 2022] GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:09.513402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-797d6c81-4ee9-456b-b145-6120c87ccdbc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Calling method '.version_select at 0x7fc3a3d75550>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:09.652995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-797d6c81-4ee9-456b-b145-6120c87ccdbc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] HTTP exception thrown: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-797d6c81-4ee9-456b-b145-6120c87ccdbc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Request method failure captured: Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 HTTP/1.1 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yyk57LGhoDdcLXF-lCkQrqEf-R-oZ4hXZpsESTF3mKpUJ2ORd5xaGMvE1PBKbSz6BjMOal4vUQ6Bwm18FgZR2ua-DoCWhSP3NM3FeqwKqZdzhFkmAIwfCsZZW8Kwa9PeWUBjexeslxBEaiDDkN5NivV2_bQ8sVupOcJ64aLqvfT6XU Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 7dcb543325c04614a6879797e81c89f7 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesGetTestJSON-722266579 Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:39:09.660857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7dcb543325c04614a6879797e81c89f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7dcb543325c04614a6879797e81c89f7", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7dcb543325c04614a6879797e81c89f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7dcb543325c04614a6879797e81c89f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesGetTestJSON-722266579 Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 7dcb543325c04614a6879797e81c89f7 Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesGetTestJSON-722266579 Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesGetTestJSON-722266579-project Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 090ce3d19b6e4e729ea07c14319db27a Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesGetTestJSON-722266579-project Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '7453fc4d-9068-4223-afdf-fdeec8a14520'} Jul 18 16:39:09.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. (HTTP 404) (Request-ID: req-d5b7e8e5-b1c1-4fb0-8aad-5117530f2c51) Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:09.662707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:39:09.663588 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:39:09.664669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:09.665512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-797d6c81-4ee9-456b-b145-6120c87ccdbc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] Returning 404 to user: Volume 7453fc4d-9068-4223-afdf-fdeec8a14520 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:09.673615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-797d6c81-4ee9-456b-b145-6120c87ccdbc tempest-VolumesGetTestJSON-722266579 tempest-VolumesGetTestJSON-722266579-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520" status: 404 len: 109 microversion: 2.1 time: 0.166405 Jul 18 16:39:09.677772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:09 2022] GET /compute/v2.1/os-volumes/7453fc4d-9068-4223-afdf-fdeec8a14520 => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:39:09.717441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5391fbf6-de8d-4c2b-b351-0bcb51531e9d tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d5ddc0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:09.853950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5391fbf6-de8d-4c2b-b351-0bcb51531e9d tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ee87e3cf-5b78-4633-9c38-8c2f7c030849" status: 200 len: 351 microversion: 2.1 time: 0.145221 Jul 18 16:39:09.862074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 4/9] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:09 2022] GET /compute/v2.1/os-volumes/ee87e3cf-5b78-4633-9c38-8c2f7c030849 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:11.811533 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-71446b0f-b71b-46db-a2db-23a4da76d2b4 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d5fee0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:11.995496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-71446b0f-b71b-46db-a2db-23a4da76d2b4 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c0f230cc-e4bc-42e1-8662-f71db11058cf" status: 200 len: 350 microversion: 2.1 time: 0.193748 Jul 18 16:39:11.996667 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 6/10] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:11 2022] GET /compute/v2.1/os-volumes/c0f230cc-e4bc-42e1-8662-f71db11058cf => generated 350 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:39:12.017539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4000714b-2e8d-4c25-aefc-92827129bb85 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d5d5e0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:12.193623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4000714b-2e8d-4c25-aefc-92827129bb85 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.182265 Jul 18 16:39:12.208111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 5/11] 10.222.0.77 () {58 vars in 1133 bytes} [Mon Jul 18 16:39:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:12.223372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0c9394f8-f832-4cd0-9125-80f1b050c426 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3cde550>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:12.465030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0c9394f8-f832-4cd0-9125-80f1b050c426 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250827 Jul 18 16:39:12.466058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1148 bytes} [Mon Jul 18 16:39:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:12.493509 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7f138bf3-75f0-4322-a606-9c5c5d985756 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d1e8b0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:12.677796 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7f138bf3-75f0-4322-a606-9c5c5d985756 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.191979 Jul 18 16:39:12.678772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1133 bytes} [Mon Jul 18 16:39:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:12.704847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a096e024-f22e-45fe-a717-f7c1ebaa343e tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a4742820>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:12.878898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a096e024-f22e-45fe-a717-f7c1ebaa343e tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.185857 Jul 18 16:39:12.880229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 8/14] 10.222.0.77 () {58 vars in 1166 bytes} [Mon Jul 18 16:39:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:39:12.911608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3aa3968a-45e7-41dd-a439-a4c5fbe57769 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d5d790>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:13.138286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3aa3968a-45e7-41dd-a439-a4c5fbe57769 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.233340 Jul 18 16:39:13.139467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 7/15] 10.222.0.77 () {58 vars in 1169 bytes} [Mon Jul 18 16:39:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:13.156052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-16466577-c333-4e2c-b193-5e6ebab83478 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3cdee50>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:13.360443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-16466577-c333-4e2c-b193-5e6ebab83478 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.211432 Jul 18 16:39:13.365108 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 9/16] 10.222.0.77 () {58 vars in 1154 bytes} [Mon Jul 18 16:39:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:13.381894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c4e23ef4-406c-40a2-9da8-7b88523faf6d tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3d1e3a0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:13.526431 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c4e23ef4-406c-40a2-9da8-7b88523faf6d tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.152212 Jul 18 16:39:13.541288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 8/17] 10.222.0.77 () {58 vars in 1187 bytes} [Mon Jul 18 16:39:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:39:13.549890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6e1c48a0-8b94-4008-8199-63ec1ee62fd4 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] Calling method '.version_select at 0x7fc3a3cdfaf0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:13.689606 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6e1c48a0-8b94-4008-8199-63ec1ee62fd4 tempest-VolumesTestJSON-567690150 tempest-VolumesTestJSON-567690150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.146361 Jul 18 16:39:13.691077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 10/18] 10.222.0.77 () {58 vars in 1154 bytes} [Mon Jul 18 16:39:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:16.181076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7ef849c1-5e32-4973-839d-bebe94efdb4a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: .version_select at 0x7fc3a3d1e040>, body: {"keypair": {"name": "tempest-keypair-2095451099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++ax+qxFHl4D/gtgEXzSgdNKQUlVHAhO6xfl3GBoo6G/JVpliSLPpv8/N49ewoN/7AkMba8gXLpA2r+U0XYT2PCVVMDcrU8E/QwER2A3Z/JqdKwPqYQtolRqtCqdCjzw=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:16.360510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-7ef849c1-5e32-4973-839d-bebe94efdb4a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:16.375461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-7ef849c1-5e32-4973-839d-bebe94efdb4a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for user 4909d4aef302404290adcd3268e53c1b and project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:16.475293 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7ef849c1-5e32-4973-839d-bebe94efdb4a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.403881 Jul 18 16:39:16.489322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 9/19] 10.222.0.77 () {62 vars in 1199 bytes} [Mon Jul 18 16:39:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1420 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 16:39:19.435496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-856032333", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:19.873219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] validate_networks() for [('07d4314d-9237-4c83-9875-1768cdeffac1', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:39:24.931555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:39:24.936968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:39:24.939180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:39:24.941727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:39:24.943474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:39:25.011830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:25.013733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:25.017611 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:25.022196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:25.127278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:25.141541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for user ab3be59ea4c74da3b4e19273102bccd9 and project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:25.185000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:39:25.199448 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:39:25.373052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-50bd5abb-d3ff-426a-91c4-20c96fe8a612 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.105357 Jul 18 16:39:25.374079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:39:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 7110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:39:25.389268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f7c08cd0-caa0-46df-b320-df7d5ea8ebb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:25.390304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f7c08cd0-caa0-46df-b320-df7d5ea8ebb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:25.424427 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d29a4eb8-9d26-4ce9-a511-1aafc019d77c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: .version_select at 0x7fc3a3cfe9d0>, body: {"keypair": {"name": "tempest-keypair-814395262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nlEGIDrBYAxKnEaiWc7a2XE8tRssO8of0pEd57csaUBjDX7b/PWBoNqBWMiTgLnepDUq6LRczhb/PCL5rm9Gvr99cQsK5SgUhffG1tx2y0aJTsP85pKDNv6C8FQDtiA=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:25.481872 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-d29a4eb8-9d26-4ce9-a511-1aafc019d77c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:25.492110 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-d29a4eb8-9d26-4ce9-a511-1aafc019d77c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:25.579115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d29a4eb8-9d26-4ce9-a511-1aafc019d77c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.639528 Jul 18 16:39:25.580598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 10/21] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:39:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:25.730762 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f7c08cd0-caa0-46df-b320-df7d5ea8ebb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:25.769065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f7c08cd0-caa0-46df-b320-df7d5ea8ebb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1221 microversion: 2.1 time: 0.384708 Jul 18 16:39:25.778858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 12/22] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:25 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1221 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:39:26.217194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1287235969", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd6b543-38a6-4937-914e-f705a5e37fe0"}], "security_groups": [{"name": "tempest-securitygroup--406106137"}], "key_name": "tempest-keypair-2095451099", "user_data": "}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:26.474898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1085819591", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:26.674595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] validate_networks() for [('07d4314d-9237-4c83-9875-1768cdeffac1', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:39:27.085891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] validate_networks() for [('6fd6b543-38a6-4937-914e-f705a5e37fe0', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:39:29.146248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:39:29.147176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:39:29.148487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:39:29.149066 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:39:29.149598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:39:29.180686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:29.182870 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:29.186615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:29.188164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:29.261413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:29.276910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for user ab3be59ea4c74da3b4e19273102bccd9 and project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:29.332885 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:39:29.343443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:39:29.583024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bc1235bc-5f5c-4e98-9b9f-ba14a7845079 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.112774 Jul 18 16:39:29.584123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 13/23] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:39:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:39:30.529993 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-704064655", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "networks": [{"uuid": "4901e171-3f10-4967-83c1-9b283cc1db72"}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:30.861730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] validate_networks() for [('4901e171-3f10-4967-83c1-9b283cc1db72', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:39:32.125390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:39:32.126234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:39:32.127228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:39:32.127975 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:39:32.129283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:39:32.191053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:32.192019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:32.193634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:32.195853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:32.307372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:32.317395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for user 4909d4aef302404290adcd3268e53c1b and project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:32.354514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:39:32.361271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:39:32.596875 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2fa4ec00-98c9-434b-bf8d-df5f8f814856 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.404625 Jul 18 16:39:32.603675 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 11/24] 10.222.0.77 () {62 vars in 1187 bytes} [Mon Jul 18 16:39:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 6413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 16:39:32.632341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:32.635011 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:32.695204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:32.698638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:32.703662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:32.704793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:33.207631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:33.242085 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d5bd1f81-acf9-488d-936a-7a98bdc9d753 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1274 microversion: 2.1 time: 0.629615 Jul 18 16:39:33.242785 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 12/25] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:32 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1274 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:33.755856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:39:33.756834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:39:33.757594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:39:33.758372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:39:33.759188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:39:33.870854 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:33.871611 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:33.873074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:33.873889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:34.073076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Getting quotas for project 49d4c19f14be46208297e4e3fb854bb0. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:34.094114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Getting quotas for user 4a0fa5ed18f2499488e01dd95a65194d and project 49d4c19f14be46208297e4e3fb854bb0. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:34.150769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:39:34.154851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:39:34.277768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3b65ee02-1daf-47dc-8778-7be7d549c890 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Action: 'create', calling method: .version_select at 0x7fc3a2375ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649008603", "metadata": {"Type": "work"}}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3b65ee02-1daf-47dc-8778-7be7d549c890 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 122 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:39:34.346059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1649008603", "metadata": {"Type": "work"}}} Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: Jul 18 16:39:34.348646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1649008603', 'metadata': {'Type': 'work'}}}} Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:34.360992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:39:34.366051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:39:34.368301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:39:34.368301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:34.368572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4fc21375-786d-48bd-8ce0-11f02da1cbd0 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.762619 Jul 18 16:39:34.368572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 14/26] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:39:34.368867 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3b65ee02-1daf-47dc-8778-7be7d549c890 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:34.371390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3b65ee02-1daf-47dc-8778-7be7d549c890 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.121827 Jul 18 16:39:34.375345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 13/27] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 18 16:39:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:39:34.399641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:34.401421 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:34.408548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1287528461", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "509e7a9e-2f1a-47ea-a4fb-2e64a591cc67"}], "security_groups": [{"name": "tempest-securitygroup--1324334721"}], "key_name": "tempest-keypair-814395262", "user_data": "}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:34.458023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:34.464171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:34.467936 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:34.471601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:35.065470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] validate_networks() for [('509e7a9e-2f1a-47ea-a4fb-2e64a591cc67', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:39:35.361293 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:35.445281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:35.454266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:35.463931 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8d3e5905-670a-41c3-a5b1-9656375f23bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1278 microversion: 2.20 time: 1.092945 Jul 18 16:39:35.467222 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 15/28] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:34 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1278 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:35.495039 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:35.497893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:35.532811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:35.535927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:35.539244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:35.546308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:36.199427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:36.220269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-579e5a16-b3a7-48bc-856f-c16397201585 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1280 microversion: 2.1 time: 0.739171 Jul 18 16:39:36.245634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 16/29] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:35 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1280 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:36.265380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:36.268645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:36.291403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:36.293818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:36.298850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:36.300582 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:36.704058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:36.732246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6ef7ee96-3ae3-4f30-b272-72ce12cf3749 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1218 microversion: 2.1 time: 0.469404 Jul 18 16:39:36.737220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 17/30] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:36 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1218 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:36.768367 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1375a364-92bd-40e8-a411-c8f78c25ca70 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Action: 'create', calling method: .version_select at 0x7fc3a2ac9ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-740902951", "metadata": {"Type": "work"}}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1375a364-92bd-40e8-a411-c8f78c25ca70 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 119 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:39:36.777067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-740902951", "metadata": {"Type": "work"}}} Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:39:36.778479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-740902951', 'metadata': {'Type': 'work'}}}} Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi '0' Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:36.779308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:39:36.780610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:39:36.781859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:39:36.781859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:36.785459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1375a364-92bd-40e8-a411-c8f78c25ca70 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:36.788538 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1375a364-92bd-40e8-a411-c8f78c25ca70 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.047556 Jul 18 16:39:36.789504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 18/31] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 18 16:39:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:39:36.803265 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:36.803980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:36.818982 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:36.819645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:36.820838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:36.821441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:37.111965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:37.136883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:37.163978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:37.165399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-29dbb734-a67a-4e1e-8b69-e8137344cd95 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1340 microversion: 2.20 time: 0.368146 Jul 18 16:39:37.166220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 19/32] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:36 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1340 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:37.183113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e16bcae6-1820-45cf-bb64-55f4399dc1ff tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Action: 'create', calling method: .version_select at 0x7fc3a2ac9d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802772056", "metadata": {"Type": "work"}}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e16bcae6-1820-45cf-bb64-55f4399dc1ff tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 119 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:39:37.206718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802772056", "metadata": {"Type": "work"}}} Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:39:37.207773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802772056', 'metadata': {'Type': 'work'}}}} Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi '' Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:37.208445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:39:37.210856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:39:37.212497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:39:37.212497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.212497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e16bcae6-1820-45cf-bb64-55f4399dc1ff tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:37.213875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e16bcae6-1820-45cf-bb64-55f4399dc1ff tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043046 Jul 18 16:39:37.214753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 20/33] 10.222.0.77 () {60 vars in 1155 bytes} [Mon Jul 18 16:39:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:39:37.229702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-27e42b1a-a775-41ba-91c1-b6a16d598540 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Calling method '.version_select at 0x7fc3a2ae5700>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:37.341132 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-27e42b1a-a775-41ba-91c1-b6a16d598540 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] HTTP exception thrown: Volume tempest-invalid-1213968545 could not be found. Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-27e42b1a-a775-41ba-91c1-b6a16d598540 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1213968545 HTTP/1.1 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:39:37.344056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Volume tempest-invalid-1213968545 could not be found. Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'tempest-invalid-1213968545'} Jul 18 16:39:37.345195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1213968545 could not be found. (HTTP 404) (Request-ID: req-f091e500-acd7-4239-86c8-f7f40202f33d) Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:37.345869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:39:37.347784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1213968545 could not be found. Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:39:37.348724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1213968545 could not be found. Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1213968545 could not be found. Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-27e42b1a-a775-41ba-91c1-b6a16d598540 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 404 to user: Volume tempest-invalid-1213968545 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-27e42b1a-a775-41ba-91c1-b6a16d598540 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1213968545" status: 404 len: 99 microversion: 2.1 time: 0.125553 Jul 18 16:39:37.349816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 21/34] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 18 16:39:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1213968545 => generated 99 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:39:37.357483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:37.358120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:37.388696 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:37.390996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:37.397292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:37.401006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:38.330004 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=5 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:38.382774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:38.401864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b9f383fb-b684-44f8-88ba-3e77c640aabb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1280 microversion: 2.1 time: 1.054089 Jul 18 16:39:38.407113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 22/35] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:37 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1280 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:38.423733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fa593e6f-dbb3-40ac-bae9-63ccaa58a5bb tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010833 Jul 18 16:39:38.426624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 23/36] 10.222.0.77 () {58 vars in 1139 bytes} [Mon Jul 18 16:39:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:39:38.451017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:38.457877 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:38.513831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:38.514985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:38.516722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:38.517542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:39.154503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:39.179257 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8d525afd-0c0a-42e5-8da3-2fdf9cbc21a3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1272 microversion: 2.1 time: 0.745490 Jul 18 16:39:39.179906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 24/37] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:38 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1272 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:39.197040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:39.197212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:39.222101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:39.222799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:39.246903 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:39.247429 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:39.478020 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:39.504174 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:39.508977 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:39.511528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-714381dd-1589-43f3-87b9-1eff02db8021 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1340 microversion: 2.20 time: 0.330358 Jul 18 16:39:39.513068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 25/38] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:39 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1340 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:39.518679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fa73268d-a82c-440d-bb2e-1fee6754d473 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004228 Jul 18 16:39:39.528195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 26/39] 10.222.0.77 () {58 vars in 1136 bytes} [Mon Jul 18 16:39:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:39:39.546189 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:39.547041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:39.576048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:39.582745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:39.588415 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:39.589088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:40.628372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:39:40.629246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:39:40.629493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:39:40.630121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:39:40.630763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:39:40.660393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=15 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:40.672553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:40.673083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:40.679837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:40.681770 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:40.786834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:40.790178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:39:40.816915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:39:40.821540 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fae68725-abbb-4f8b-8a4e-49fb23ea26cb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 1.290889 Jul 18 16:39:40.831677 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 27/40] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:39 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:40.852280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-de3d0d0a-774b-474d-9518-8a24ceffd9ae tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Calling method '.version_select at 0x7fc3a2ac9670>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:40.878971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:39:40.888071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:39:40.981763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ea09ba13-a2cf-46fd-9c36-c8518c2913c1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.599801 Jul 18 16:39:40.984139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 14/41] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:39:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 6608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:39:40.997955 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:41.003885 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:41.064790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:41.067645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:41.072457 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:41.082301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:41.372726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:41.414017 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8371a1a6-a05d-41fe-8b30-1f69adc99431 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1272 microversion: 2.1 time: 0.424212 Jul 18 16:39:41.414756 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 15/42] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:40 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1272 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:41.427765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-de3d0d0a-774b-474d-9518-8a24ceffd9ae tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] HTTP exception thrown: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-de3d0d0a-774b-474d-9518-8a24ceffd9ae tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/os-volumes/e49b3158-4f40-4000-9fe3-f2d09f7a8887 HTTP/1.1 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:39:41.434664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'e49b3158-4f40-4000-9fe3-f2d09f7a8887'} Jul 18 16:39:41.435898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. (HTTP 404) (Request-ID: req-d6c287bd-a7e5-4b22-bc20-f03fff11d3c5) Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:41.436764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:39:41.437984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:39:41.439253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-de3d0d0a-774b-474d-9518-8a24ceffd9ae tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 404 to user: Volume e49b3158-4f40-4000-9fe3-f2d09f7a8887 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:41.440633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-de3d0d0a-774b-474d-9518-8a24ceffd9ae tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/e49b3158-4f40-4000-9fe3-f2d09f7a8887" status: 404 len: 109 microversion: 2.1 time: 0.602863 Jul 18 16:39:41.441477 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 28/43] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:39:40 2022] DELETE /compute/v2.1/os-volumes/e49b3158-4f40-4000-9fe3-f2d09f7a8887 => generated 109 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:39:41.454553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:41.481769 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:41.489024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-24a4ca23-ec02-4822-9bef-daa8115d4d9d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:41.493612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-24a4ca23-ec02-4822-9bef-daa8115d4d9d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:41.506995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:41.511090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:41.513879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:41.515045 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:41.845542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:41.871092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:41.880105 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:41.885484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ca8c8062-bedd-465b-acf1-3669ba113446 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1340 microversion: 2.20 time: 0.466587 Jul 18 16:39:41.886134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 16/44] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:41 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1340 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:41.908309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c13c34db-10b9-4ddd-82f3-127b6945cf22 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Calling method '.version_select at 0x7fc3a228b430>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:42.092269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-c13c34db-10b9-4ddd-82f3-127b6945cf22 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] HTTP exception thrown: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c13c34db-10b9-4ddd-82f3-127b6945cf22 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Request method failure captured: Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/os-volumes/46cf1d31-be2f-46c4-af06-7f103e1b94c9 HTTP/1.1 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1YzCoOsY90LiA6EyhbNA6iLbQPB6kicaRHWxymODlREcXrkxKt8eJpJIpoOZf2M4KrOQ3IoA3ygf2NOF8KYZLzKQZyZZizWqfn3s-nJSMcubdN4vEjqR-A19t9Imw55AFOslxMdqAaYF0Fh05EY1H5bFXA_G-SA2ZNYlmaDCMIbhKgM Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:39:42.096554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9722e5dc37ca423592891a601f0a0632", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9722e5dc37ca423592891a601f0a0632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 9722e5dc37ca423592891a601f0a0632 Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesNegativeTest-1895815432 Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4a36240c9a3d48c2b17ec0f275073f22 Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesNegativeTest-1895815432-project Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '46cf1d31-be2f-46c4-af06-7f103e1b94c9'} Jul 18 16:39:42.119248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. (HTTP 404) (Request-ID: req-3b630598-6fdd-4952-9281-8fba24523100) Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:42.121086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:39:42.124999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:39:42.127776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c13c34db-10b9-4ddd-82f3-127b6945cf22 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] Returning 404 to user: Volume 46cf1d31-be2f-46c4-af06-7f103e1b94c9 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c13c34db-10b9-4ddd-82f3-127b6945cf22 tempest-VolumesNegativeTest-1895815432 tempest-VolumesNegativeTest-1895815432-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/46cf1d31-be2f-46c4-af06-7f103e1b94c9" status: 404 len: 109 microversion: 2.1 time: 0.208067 Jul 18 16:39:42.133800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 17/45] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:39:41 2022] GET /compute/v2.1/os-volumes/46cf1d31-be2f-46c4-af06-7f103e1b94c9 => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:39:42.137957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:42.137957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:42.153796 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:42.153796 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:42.154232 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:42.155631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:42.259825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-24a4ca23-ec02-4822-9bef-daa8115d4d9d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:42.273917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-24a4ca23-ec02-4822-9bef-daa8115d4d9d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1241 microversion: 2.1 time: 0.831970 Jul 18 16:39:42.276558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 29/46] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:41 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1241 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:42.449034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:42.450886 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:42.469143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=9 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:42.475423 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:42.480478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:42.482771 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:42.484882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:43.329763 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:43.410908 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f9c74060-e181-4178-a374-eb7c6e3d0ce1 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1272 microversion: 2.1 time: 0.961092 Jul 18 16:39:43.412109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 30/47] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:42 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1272 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:43.452563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:43.467779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:43.485431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:43.488475 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:43.490711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:43.496799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:43.671914 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:43.698247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:43.710344 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:43.711893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f4a3c642-7a79-42e7-b1bf-920b03831e3d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1340 microversion: 2.20 time: 0.292870 Jul 18 16:39:43.732930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 31/48] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:43 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1340 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:43.748797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:43.749953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:43.759086 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:43.759991 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:43.765095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:43.767457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:43.965377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=6 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:44.412693 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:44.453376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a399e108-ba82-43f1-be3b-c55672ffa426 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1293 microversion: 2.1 time: 0.716364 Jul 18 16:39:44.459547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 32/49] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:43 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1293 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:44.477621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:44.484691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:44.510476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:44.515067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:44.519500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:44.524415 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:45.108164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:45.180886 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e4130e57-9160-4a60-8505-e1d0fda823fa tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1272 microversion: 2.1 time: 0.718824 Jul 18 16:39:45.182225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 33/50] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:44 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1272 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:45.257733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:45.266138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:45.296835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:45.323128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:45.324830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:45.328169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:46.203193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:46.235359 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:46.258396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:46.262097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:46.264463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-df303355-e384-4267-90c9-3686e2af04bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1340 microversion: 2.20 time: 1.068911 Jul 18 16:39:46.280807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 34/51] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:45 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1340 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:46.306261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-868e709a-5d7d-4929-8941-357531c7e22e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 4.203657 Jul 18 16:39:46.314076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:46.315331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:46.316380 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 18/52] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:42 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 4217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:46.341484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:46.355881 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:46.374968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:46.375295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:46.376623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:46.377003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:46.378479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:46.379159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:46.379321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:46.380583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:46.668019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:46.693998 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c1a662d6-dcba-4ef7-97f3-668d221fd1bf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1272 microversion: 2.1 time: 0.374475 Jul 18 16:39:46.702115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 19/53] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:46 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:47.260804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:47.277956 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0ab7a703-54a6-4230-882e-43ff7df68af9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1299 microversion: 2.1 time: 0.994230 Jul 18 16:39:47.291745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 35/54] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:46 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1299 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:47.315605 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:47.320868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:47.353470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:47.354685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:47.356985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:47.370624 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:47.375766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:47.378901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:47.393358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:47.401955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:47.410494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:47.411880 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:48.867479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:48.906820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:48.917702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:48.926577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d454c5e1-f202-4c17-a7f4-83400ef073e3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 1.612065 Jul 18 16:39:48.944891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 20/55] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:47 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:48.990397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:48.996283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:49.030225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:49.032848 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:49.038982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:49.047252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:49.708203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:49.718535 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2feb7c66-aeca-4155-9437-b506b9a0d626 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.751942 Jul 18 16:39:49.730942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 21/56] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:48 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:49.741054 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:49.742972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:49.774949 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:49.775439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:49.776318 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:49.776766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:49.839944 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:49.861628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d6570e54-3988-49ed-a879-ff5478d8fa6a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 2.513875 Jul 18 16:39:49.864257 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 36/57] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:47 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:50.069120 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:50.108868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1c64f855-baa7-4fa2-b255-ada9ae02da6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1299 microversion: 2.1 time: 0.372354 Jul 18 16:39:50.125686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 22/58] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:49 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:50.169153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:50.173183 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:50.214911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.216193 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.225183 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.228978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.456697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a79035e5-5cec-4bca-bf52-215a7d5317c8 req-decbeb95-cb37-49c9-ba28-2df924fa66b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5818de22-86dc-4174-86ff-b7e7d2873b35", "tag": "2c938ddc-cf79-46fa-8c47-ae2bce6cd76b"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:50.498241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a79035e5-5cec-4bca-bf52-215a7d5317c8 req-decbeb95-cb37-49c9-ba28-2df924fa66b0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.499032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a79035e5-5cec-4bca-bf52-215a7d5317c8 req-decbeb95-cb37-49c9-ba28-2df924fa66b0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.600802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a79035e5-5cec-4bca-bf52-215a7d5317c8 req-decbeb95-cb37-49c9-ba28-2df924fa66b0 service nova] Creating event network-changed:2c938ddc-cf79-46fa-8c47-ae2bce6cd76b for instance 5818de22-86dc-4174-86ff-b7e7d2873b35 on hv-cinder-83754 Jul 18 16:39:50.601409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a79035e5-5cec-4bca-bf52-215a7d5317c8 req-decbeb95-cb37-49c9-ba28-2df924fa66b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:39:50.619023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.619534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.620440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.620881 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.654355 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:50.680140 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.compute.rpcapi [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:39:50.681345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] Releasing lock "compute-rpcapi-router" {{(pid=129672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:39:50.733146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4275b77e-01e4-4cdc-b6a4-b2d75c1a3daa None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.866025 Jul 18 16:39:50.733825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 37/59] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:50.747085 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:50.752814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:50.753522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:50.778575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.779038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.779855 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:50.780292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:50.858965 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=5 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:51.444249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:51.462191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8f5214fa-44b4-47fd-925b-1f95721225df tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.710666 Jul 18 16:39:51.465534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 38/60] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:50 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:39:51.482249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:51.484168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:51.508435 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:51.509837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:51.511888 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:51.512476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:51.583453 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:51.611234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:51.613059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:51.615336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a7dd4399-8157-44ae-b256-818e2285023b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 1.487154 Jul 18 16:39:51.616398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 23/61] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:50 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:51.638874 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:51.639337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:51.648468 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:51.649392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:51.650671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:51.652247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:51.958144 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:51.978901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-306dadff-e2d6-427b-8427-9a5c738768b4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.510075 Jul 18 16:39:51.980404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 39/62] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:51 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:52.271282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=22 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:52.400269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-65594cc9-13c0-408a-8dfc-2f73768e9f6e req-0737ba84-07c8-4b25-aac2-d85e3571bd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbd76b7-87e8-4bf3-891e-84558f463c32", "tag": "8bbd976a-e758-4e52-b7e2-3637c08e0c46"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:52.432407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-65594cc9-13c0-408a-8dfc-2f73768e9f6e req-0737ba84-07c8-4b25-aac2-d85e3571bd7b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:52.434583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-65594cc9-13c0-408a-8dfc-2f73768e9f6e req-0737ba84-07c8-4b25-aac2-d85e3571bd7b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:52.477167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:52.503351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0f9ceb5e-d780-4f15-9d8a-06b901f6889d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.870050 Jul 18 16:39:52.507348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-65594cc9-13c0-408a-8dfc-2f73768e9f6e req-0737ba84-07c8-4b25-aac2-d85e3571bd7b service nova] Creating event network-changed:8bbd976a-e758-4e52-b7e2-3637c08e0c46 for instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 on hv-cinder-83754 Jul 18 16:39:52.516093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 24/63] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:51 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:52.529075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-65594cc9-13c0-408a-8dfc-2f73768e9f6e req-0737ba84-07c8-4b25-aac2-d85e3571bd7b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545133 Jul 18 16:39:52.536629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 40/64] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:52.539530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:52.540901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:52.554177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:52.555150 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:52.557249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:52.560337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:52.643091 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:52.644458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:52.659710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:52.660440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:52.665961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:52.669191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:53.008215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:53.055482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-86b1ca08-cf6b-47bf-9ebd-aa8f22b29544 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.532769 Jul 18 16:39:53.055482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 25/65] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:52 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:53.084378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.086624 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:53.117284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:53.118628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:53.120009 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:53.120675 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:54.423633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:54.438859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:54.442850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:54.446306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-50bbf10c-f011-439c-96de-d789de10a46b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 1.809590 Jul 18 16:39:54.459466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 41/66] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:52 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:54.464709 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:54.465733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:54.473695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:54.474572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:54.476596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:54.477400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:54.733002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:54.759201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-12f118fb-9c0e-4f5f-a8b3-1b20722d1f3e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 1.695944 Jul 18 16:39:54.774443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 26/67] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:53 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:54.784652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:54.791593 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:54.817131 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:54.817582 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:54.819068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:54.819520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.519540 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:55.523639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=81 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:55.542625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3e0247e2-8e46-43db-aabd-3c75c6d13af7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.777246 Jul 18 16:39:55.543641 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 27/68] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:54 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:55.582465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7", "tag": "3cef60a6-8b3b-4cfe-9cec-c800df0d9278"}, {"name": "network-changed", "server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:55.607764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:55.626380 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.627134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.638948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dd736c86-f4f4-4e23-97ac-b7ab0bfd038e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 1.176288 Jul 18 16:39:55.649368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 42/69] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:54 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:55.660023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:55.663534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:55.685718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.698493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.698493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.698493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.759052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Creating event network-changed:3cef60a6-8b3b-4cfe-9cec-c800df0d9278 for instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 on hv-cinder-83754 Jul 18 16:39:55.759865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Creating event network-changed:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:39:55.760441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-51212033-375f-4477-ac90-df691c19a2de req-4e6dce23-1fb0-43b7-a9c5-8920c0414576 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:39:55.766089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.772138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.780114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.781378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.830980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.compute.rpcapi [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:39:55.833195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] Releasing lock "compute-rpcapi-router" {{(pid=129671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:39:55.894547 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-13cfea2c-7445-49e6-ba39-e2c5f2afad5d None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.325728 Jul 18 16:39:55.896160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 28/70] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:55.923836 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:55.925108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:55.973803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.975716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:55.976769 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:55.977392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:56.916479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:56.942189 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:56.949317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:56.954237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5e4ad2d2-4b8c-4261-a38d-d6bb89a0614e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 1.308424 Jul 18 16:39:56.955638 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 43/71] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:55 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:56.965053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:56.966521 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:56.985007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:56.987895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:56.991879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:56.994678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:57.012969 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:57.022343 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b7d8728e-74be-4d8a-924c-cd8bee4b5825 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 1.124043 Jul 18 16:39:57.023280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 29/72] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:55 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:57.029859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:57.030811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:57.057859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:57.058660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:57.059656 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:57.060267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:57.499811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:57.533666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2a979c2a-b25e-48d6-b854-688b04b42d7b tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.571365 Jul 18 16:39:57.534734 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 44/73] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:56 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:57.560955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-b663662d-cf84-4dc5-9a7b-475c63a15048 req-2e6a1a12-7d7a-478b-a340-594ad6ee2e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642fda3b-e6f4-48c5-ba7f-d619553351fd", "tag": "a4fdf947-4005-4728-8f93-b30af2b7db4b"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:39:57.581591 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b663662d-cf84-4dc5-9a7b-475c63a15048 req-2e6a1a12-7d7a-478b-a340-594ad6ee2e3d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:57.582450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b663662d-cf84-4dc5-9a7b-475c63a15048 req-2e6a1a12-7d7a-478b-a340-594ad6ee2e3d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:57.621523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-b663662d-cf84-4dc5-9a7b-475c63a15048 req-2e6a1a12-7d7a-478b-a340-594ad6ee2e3d service nova] Creating event network-changed:a4fdf947-4005-4728-8f93-b30af2b7db4b for instance 642fda3b-e6f4-48c5-ba7f-d619553351fd on hv-cinder-83754 Jul 18 16:39:57.632303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-b663662d-cf84-4dc5-9a7b-475c63a15048 req-2e6a1a12-7d7a-478b-a340-594ad6ee2e3d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095450 Jul 18 16:39:57.634346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 45/74] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:57.975118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:57.975818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:57.986604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:57.992621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:57.993303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:57.993867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:57.994304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:58.006847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c42227ad-81ae-4105-81b7-34d39986b3ab tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.982168 Jul 18 16:39:58.012417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 30/75] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:57 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:58.064723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:58.065652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:58.084752 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:58.085356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:58.086645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:58.087438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:58.576856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:58.586738 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:58.594254 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:58.596972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-345a448e-e67d-4545-a1f0-dd0996a8673a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.625674 Jul 18 16:39:58.603144 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 46/76] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:57 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:39:58.612705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:58.613684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:58.631325 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:58.633178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:58.634559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:58.635645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:58.636699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:58.662395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7a9c15e7-d010-4fe8-8cdf-7eb095b68cbb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.609247 Jul 18 16:39:58.664683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 31/77] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:58 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:39:59.046078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:59.050707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:59.081052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.083109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:59.088039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.089182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:59.417096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:59.430197 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:39:59.452930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3d2c8713-d544-43e0-b55e-dd421ab9b436 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.416287 Jul 18 16:39:59.464148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-574d3296-0b27-41d9-b4e5-5d8aacbe7129 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.857123 Jul 18 16:39:59.467216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 32/78] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:59 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:39:59.481345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 47/79] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:58 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:59.635167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:59.636667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:59.651908 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.655024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:59.658097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.662425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:59.682976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:59.683069 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:39:59.693195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.697202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:39:59.698457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:39:59.700090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.133430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.145206 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.148566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.151295 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1b6540c7-a1cf-4723-8c33-86be6bcf4c28 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.521065 Jul 18 16:40:00.153308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 33/80] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:39:59 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:00.243694 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.253121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-19740520-528d-4a0e-a4f3-2493d4561fce tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.576048 Jul 18 16:40:00.264463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 48/81] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:39:59 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:00.443587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-486f9293-09bf-4d31-b4c4-f9cdcb96eed9 req-b897288a-f939-47f0-8efc-fa92c32a04f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5818de22-86dc-4174-86ff-b7e7d2873b35", "name": "network-vif-plugged", "status": "completed", "tag": "2c938ddc-cf79-46fa-8c47-ae2bce6cd76b"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:00.453505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-486f9293-09bf-4d31-b4c4-f9cdcb96eed9 req-b897288a-f939-47f0-8efc-fa92c32a04f2 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:00.454288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-486f9293-09bf-4d31-b4c4-f9cdcb96eed9 req-b897288a-f939-47f0-8efc-fa92c32a04f2 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.471360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:00.472847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:00.481193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:00.483627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-486f9293-09bf-4d31-b4c4-f9cdcb96eed9 req-b897288a-f939-47f0-8efc-fa92c32a04f2 service nova] Creating event network-vif-plugged:2c938ddc-cf79-46fa-8c47-ae2bce6cd76b for instance 5818de22-86dc-4174-86ff-b7e7d2873b35 on hv-cinder-83754 Jul 18 16:40:00.484435 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.485461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:00.489296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.493945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-486f9293-09bf-4d31-b4c4-f9cdcb96eed9 req-b897288a-f939-47f0-8efc-fa92c32a04f2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337443 Jul 18 16:40:00.500339 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 34/82] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:00.506718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:00.507743 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:00.515531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:00.516379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.517256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:00.517765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:00.655155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:00.726306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.739341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3739e180-16d2-4c96-a7e0-0aaebe6aaa6a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.272533 Jul 18 16:40:00.740989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 49/83] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:00 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:00.783044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:00.791565 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b42f8ae0-2411-4cf8-95a8-b65d5516e183 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.289679 Jul 18 16:40:00.792207 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 35/84] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:00 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:01.171563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:01.173016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:01.181219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.182308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.182898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.188620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.272172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:01.273074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:01.281106 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.282090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.288104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.290575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.435092 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:01.447722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:01.449980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:01.451448 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0ec7a32d-a18e-435c-9b81-2c8862542d2c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.284808 Jul 18 16:40:01.462557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 50/85] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:01 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:01.556578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:01.576180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e864d3e3-858d-4060-8041-0ce423f4e2f6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.308247 Jul 18 16:40:01.578472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 36/86] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:01 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:01.767049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:01.768092 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:01.777201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.778015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.778971 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.779561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.826598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:01.827757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:01.842217 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.843087 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:01.844564 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:01.845446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:02.070272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.088294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5bc550a9-9682-47b4-a379-dae3af1a30f2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.327087 Jul 18 16:40:02.090087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 51/87] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:01 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:02.103963 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.113081 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-39c7ea2a-8780-4a92-9ac0-a703494b2042 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.296408 Jul 18 16:40:02.118909 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 37/88] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:01 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:02.469295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:02.470067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:02.477202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:02.477387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:02.478243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:02.478831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:02.616691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:02.618829 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:02.635826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:02.636970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:02.638779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:02.640179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:02.731516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.749175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.752344 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.754378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-583d99e6-3508-4dad-a4ae-7a2daca65751 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.288974 Jul 18 16:40:02.756288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 52/89] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:02 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:02.906204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:02.920914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-19cbb8d6-3917-4fda-83a2-704a47abe153 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.319613 Jul 18 16:40:02.921910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 38/90] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:02 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:03.117534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:03.118717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:03.133907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:03.135319 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:03.139776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.144823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.146360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.147565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.148190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.149566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.150600 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.151035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.371660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:03.384872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-28f78247-9bfc-4479-84ee-ff06c442688a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.275646 Jul 18 16:40:03.385927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 53/91] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:03 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:03.402443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:03.419728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cf65687a-6ca8-4f18-9976-cba91b74d93c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.292783 Jul 18 16:40:03.421897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 39/92] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:03 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:03.784269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:03.785211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:03.798938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.801729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.804161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.808298 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.934837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-a97b3023-79b8-4805-8225-b45b9d4f78ee req-55dc50ed-b074-46e8-9244-0ed01e8e097d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd76b7-87e8-4bf3-891e-84558f463c32", "name": "network-vif-plugged", "status": "completed", "tag": "8bbd976a-e758-4e52-b7e2-3637c08e0c46"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:03.948560 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-a97b3023-79b8-4805-8225-b45b9d4f78ee req-55dc50ed-b074-46e8-9244-0ed01e8e097d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:03.949269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-a97b3023-79b8-4805-8225-b45b9d4f78ee req-55dc50ed-b074-46e8-9244-0ed01e8e097d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:03.966187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-a97b3023-79b8-4805-8225-b45b9d4f78ee req-55dc50ed-b074-46e8-9244-0ed01e8e097d service nova] Creating event network-vif-plugged:8bbd976a-e758-4e52-b7e2-3637c08e0c46 for instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 on hv-cinder-83754 Jul 18 16:40:03.976348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-a97b3023-79b8-4805-8225-b45b9d4f78ee req-55dc50ed-b074-46e8-9244-0ed01e8e097d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046613 Jul 18 16:40:03.979807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 40/93] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:03.994947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:03.995969 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:04.003623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.004493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.005612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.006542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.242919 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.258165 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.260223 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.261813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7675373a-9641-47bf-9921-ed322aa1cc41 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.482314 Jul 18 16:40:04.262670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 54/94] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:03 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:04.328197 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.342241 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fab2c1cd-3a1c-4c02-bfcb-a7d4406aa187 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.358297 Jul 18 16:40:04.342963 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 41/95] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:03 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:04.421516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:04.425612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:04.459097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:04.460357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:04.468252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.469272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.470756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.473234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.478583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.479363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.480794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:04.481683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:04.933760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.936076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:04.941707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:04.946002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3d142cae-7baa-4080-b7e5-d0e0a245e9f4 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.497744 Jul 18 16:40:04.947331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 42/96] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:04 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:04.960840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bd679571-3745-4ddf-99f4-c911720f9058 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.548758 Jul 18 16:40:04.965921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 55/97] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:04 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:05.285520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:05.287938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:05.297122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.297720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.299317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.300046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.360817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:05.361756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:05.369269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.370669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.372670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.373131 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.616608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:05.627195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-beb4dffe-9fc5-4113-a182-2f0ff9108be7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.270003 Jul 18 16:40:05.628019 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 56/98] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:05 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:05.640671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:05.650824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:05.652859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:05.654429 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7eaaf00a-0447-429a-a6bb-32e9ff69d828 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.376638 Jul 18 16:40:05.655360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 43/99] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:05 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:05.964852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:05.965525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:05.972687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.973303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.974868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.975498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.980986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:05.981837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:05.988347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:05.991646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.992113 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:05.992923 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:05.993437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:06.193476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:06.194503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:06.212990 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0b4906c5-d5c6-4243-8ceb-0ba81d587c21 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.252455 Jul 18 16:40:06.214216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 57/100] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:05 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:06.219484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e53a8685-3633-48ed-b644-2794b081df04 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.238520 Jul 18 16:40:06.220367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 44/101] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:05 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:06.663994 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:06.668214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:06.690156 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:06.691542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:06.702506 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:06.703346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:06.704767 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:06.705590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:06.707781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:06.708508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:06.709561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:06.710160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:06.981524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:06.982161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:06.992590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6967ce65-873b-41ab-afa5-c4891480550b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.350042 Jul 18 16:40:06.994143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 58/102] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:06 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:06.996752 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:07.000235 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:07.002444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-86462db8-c5e7-4bfd-b874-cff6fe66e474 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.322939 Jul 18 16:40:07.011936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 45/103] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:06 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:07.241413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:07.242190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:07.249088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:07.249532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:07.250263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:07.250688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:07.251275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:07.251435 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:07.268631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:07.269517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:07.275271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:07.276091 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:07.285193 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:07.455982 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:07.471653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0672d6f1-bfbc-41fd-a6ae-26c2198c8997 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.234586 Jul 18 16:40:07.473018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 59/104] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:07 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:07.509959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:07.518236 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7bdf2230-d7ea-404d-a338-2b5e87118b3e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.275186 Jul 18 16:40:07.518853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 46/105] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:07 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:08.017397 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:08.018242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:08.027929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.028968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.030147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.030323 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:08.031041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.031667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:08.041958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.042703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.043964 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.044684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.267205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:08.270114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:08.281054 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d4083aea-7b48-4c58-b0aa-6324b2ad94c0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.267035 Jul 18 16:40:08.281389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:08.294446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:08.294446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5763b6fa-70d4-4de6-bf04-8444fc930fbf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.260643 Jul 18 16:40:08.294446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 47/106] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:08 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:08.295801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 60/107] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:08 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:08.495939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:08.496870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:08.502983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:08.512258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.513278 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.514722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.515441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.538163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:08.538349 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:08.551211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.555172 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.556643 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:08.557439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:08.814290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:08.827722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7aa8e27b-9630-4b85-b249-ddfb9424044c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.340097 Jul 18 16:40:08.828689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 48/108] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:08 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:09.260138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:09.279093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-392cf413-bf0e-4c89-8a26-5ad4316c4fc8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.745783 Jul 18 16:40:09.280814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 61/109] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:08 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:09.309216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:09.309967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:09.310127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:09.312736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:09.317395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.318386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:09.319243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.319690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:09.323804 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.324842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:09.326268 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.327087 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:09.516231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:09.525815 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-93b68443-d047-4fcb-a938-5b71570e124b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.220556 Jul 18 16:40:09.526757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 62/110] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:09 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:09.561881 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:09.571225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:09.575006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:09.576167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f9b65df8-34fd-4fb3-a87e-2828ce0c82e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.276739 Jul 18 16:40:09.576866 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 49/111] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:09 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:09.859717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:09.861244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:09.873274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.874870 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:09.877081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:09.878395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.094141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.106832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f23c795c-d6e4-4549-9eff-cf383c972861 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.254735 Jul 18 16:40:10.107856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 63/112] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:09 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:10.311895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:10.312543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:10.319555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.319922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.320701 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.321132 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.472333 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.484559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5b072a3c-d39c-4c3c-946c-655bd6e4bb0c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.176195 Jul 18 16:40:10.485612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 50/113] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:10 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:10.546778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:10.546778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:10.552348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.552827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.553645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.554065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.605125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:10.606219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:10.615365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.616080 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.617390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:10.618033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:10.706805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.715185 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1cb11149-cbcb-44a6-8d60-b1e0a19db91f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.174981 Jul 18 16:40:10.715765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 64/114] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:10 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:10.781622 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.792231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.793764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:10.795001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f36142b2-03de-4b91-963b-03fb35fa35f6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.197129 Jul 18 16:40:10.795723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 51/115] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:10 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:11.135594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:11.136264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:11.144440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.145036 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.146746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.147171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.328308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.337221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3f894021-5811-42d5-a67a-73b1fcb95e8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.209631 Jul 18 16:40:11.337828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 65/116] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:11 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:11.503090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:11.503684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:11.510828 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.511271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.512040 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.512470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.693766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.701776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4e6de3a0-0a50-4158-93db-74f1eaadd5b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.202644 Jul 18 16:40:11.702360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 52/117] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:11 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:11.733010 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:11.733646 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:11.740274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.740711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.741474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.741960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.814894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:11.815426 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:11.822300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.823165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.823550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:11.823996 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:11.881495 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.890722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5f1d7c53-3194-4ff3-93f9-c41bbf18de27 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.161408 Jul 18 16:40:11.891297 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 66/118] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:11 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:11.983205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.992156 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.993676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:11.994850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-266bfd22-8484-4b59-a372-ccf345718310 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.184828 Jul 18 16:40:11.995425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 53/119] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:11 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:12.357442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:12.358323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:12.369125 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.369798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.371273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.372134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.566856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:12.575510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f83e3d4b-e1af-438c-b4d9-d44a46ea4c8d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.223902 Jul 18 16:40:12.576451 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 67/120] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:12 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:12.729952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:12.732565 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:12.750161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.751055 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.752775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.753584 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.806599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-8e9267e2-3488-49dd-a3d8-68ca5cece636 req-405924df-9a23-4b12-9c1d-d782225ebe6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "name": "network-vif-plugged", "status": "completed", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:12.817500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=76 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:12.826590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-8e9267e2-3488-49dd-a3d8-68ca5cece636 req-405924df-9a23-4b12-9c1d-d782225ebe6c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.827687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-8e9267e2-3488-49dd-a3d8-68ca5cece636 req-405924df-9a23-4b12-9c1d-d782225ebe6c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.855252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-8e9267e2-3488-49dd-a3d8-68ca5cece636 req-405924df-9a23-4b12-9c1d-d782225ebe6c service nova] Creating event network-vif-plugged:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:40:12.866111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-8e9267e2-3488-49dd-a3d8-68ca5cece636 req-405924df-9a23-4b12-9c1d-d782225ebe6c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067129 Jul 18 16:40:12.867564 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 68/121] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:12.921099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:12.923773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:12.939609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.941770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:12.944265 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:12.945518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:13.035673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.051145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b4b437c6-9d5d-4bc9-b0b7-a166d0fcba5e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.332237 Jul 18 16:40:13.052937 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 54/122] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:12 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:13.066622 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:13.068192 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:13.075245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:13.075723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:13.076979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:13.077643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:13.153764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.170011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-edef6cf6-252f-4f38-a4c8-c92b8a623a73 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.260655 Jul 18 16:40:13.171938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 69/123] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:12 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:13.240551 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.249244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.250791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.251920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1c368a24-3a09-40ae-897c-c042fb2adeb2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.197554 Jul 18 16:40:13.252525 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 55/124] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:13 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:13.596334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:13.597345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:13.604776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:13.605265 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:13.606071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:13.606586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:13.763578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:13.772449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a483b455-37a5-4f06-8f00-72acea2d4349 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.182296 Jul 18 16:40:13.773203 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 70/125] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:13 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:14.069712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:14.070377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:14.077163 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.077689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.078626 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.079097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.188647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:14.189406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:14.196079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.196518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.197286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.197743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.228667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.240671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-be1e067f-abf4-40eb-a4db-7d0c84bc75fc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.174721 Jul 18 16:40:14.241307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 56/126] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:14 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:14.275481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:14.276664 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:14.288423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.289234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.290648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.291446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.377153 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.388958 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9f941c84-894c-4f52-9046-34d790ec01ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.203846 Jul 18 16:40:14.389988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 71/127] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:14 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:14.484389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.492970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.494649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.495786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-60cbb2ca-e7b8-4e0e-b625-f0a7a29a77b8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.228516 Jul 18 16:40:14.496358 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 57/128] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:14 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:14.790775 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:14.791404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:14.798025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.798540 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.799354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.799786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.898008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-25f6e628-9e74-4063-a4ca-4ff6d6467d02 req-e49fa116-9dfa-43ad-bc56-7cf3afaf9672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7", "name": "network-vif-plugged", "status": "completed", "tag": "3cef60a6-8b3b-4cfe-9cec-c800df0d9278"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:14.910665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-25f6e628-9e74-4063-a4ca-4ff6d6467d02 req-e49fa116-9dfa-43ad-bc56-7cf3afaf9672 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:14.911010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-25f6e628-9e74-4063-a4ca-4ff6d6467d02 req-e49fa116-9dfa-43ad-bc56-7cf3afaf9672 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:14.933165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-25f6e628-9e74-4063-a4ca-4ff6d6467d02 req-e49fa116-9dfa-43ad-bc56-7cf3afaf9672 service nova] Creating event network-vif-plugged:3cef60a6-8b3b-4cfe-9cec-c800df0d9278 for instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 on hv-cinder-83754 Jul 18 16:40:14.941723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-25f6e628-9e74-4063-a4ca-4ff6d6467d02 req-e49fa116-9dfa-43ad-bc56-7cf3afaf9672 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047001 Jul 18 16:40:14.943433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 58/129] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:40:14.964620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:14.973596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-20ed8ecb-14a4-4876-b48a-a6638511117e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.186856 Jul 18 16:40:14.974253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 72/130] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:14 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:15.260799 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:15.261936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:15.273709 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.274517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.275915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.276652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.408093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:15.408702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:15.416541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.416653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.417428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.418082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.424975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:15.440188 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:15.449634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-67cfa871-8bde-41b6-b148-646b91fe58e5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.195490 Jul 18 16:40:15.450142 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 59/131] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:15 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:15.518093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:15.519242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:15.528442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.528894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.529685 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:15.530161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:15.587529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:15.603587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c38101e5-6c74-47b0-be93-71fa02ccbce7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1322 microversion: 2.1 time: 0.198960 Jul 18 16:40:15.604674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 73/132] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:15 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:15.739038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:15.755462 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:15.759098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:15.761570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1add3da7-d27d-4909-97b0-7f3d7fc47ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.249669 Jul 18 16:40:15.768521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 60/133] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:15 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:16.006528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:16.007863 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:16.022181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.023342 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.025627 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.026351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.316400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:16.329693 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-385a3774-8268-45d2-aa53-7e1931fdbf22 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.332510 Jul 18 16:40:16.330735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 74/134] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:15 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:16.472505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:16.474298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:16.482787 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.482787 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.483815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.484208 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.630249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:16.631611 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:16.638859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.639624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.640648 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.641291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.728666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:16.743899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ea98c8e0-1c83-403b-9d2f-eea3084fc96e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.274988 Jul 18 16:40:16.759064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 61/135] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:16 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:16.797490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:16.798784 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:16.812761 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.813998 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.815800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.817196 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.918661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:16.936260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-00eff6f0-6d42-44c8-855b-4d444e4a831a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1516 microversion: 2.1 time: 0.310392 Jul 18 16:40:16.937319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 75/136] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:16 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:16.965797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:16.967231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:16.975260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.976287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:16.977484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:16.978055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.042397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:17.047028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'flavor' on Instance uuid 0dbd76b7-87e8-4bf3-891e-84558f463c32 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:40:17.058930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:17.062100 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:17.064503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ca03bbfe-4f5c-4b80-815d-8f0426e136ec tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.275519 Jul 18 16:40:17.072099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 62/137] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:16 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:17.189103 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6c4b0014-83f5-4244-89f0-c0b2d5df1740 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32/action" status: 200 len: 32 microversion: 2.1 time: 0.229029 Jul 18 16:40:17.189713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 76/138] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:40:16 2022] POST /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 16:40:17.201889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:17.202920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:17.211222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.211722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.212578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.214570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.235870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:17.359068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:17.360806 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:17.375276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.376572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.378338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.379607 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.496464 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:17.517934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-395261e8-8a4f-40d4-bba1-908f44255d04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.320094 Jul 18 16:40:17.519218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 63/139] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:17 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:17.776991 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:17.778191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:17.783921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:17.798178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7804a603-ca39-4693-8e5b-e09a2090cab9 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.446177 Jul 18 16:40:17.799122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 77/140] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:17 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:17.811831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.812871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.818016 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.818838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:17.975525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-d94bc811-6370-4c57-839e-a3ca2116fe15 req-ea106865-230e-4c2c-a230-ed5265d2bcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642fda3b-e6f4-48c5-ba7f-d619553351fd", "name": "network-vif-plugged", "status": "completed", "tag": "a4fdf947-4005-4728-8f93-b30af2b7db4b"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:17.996568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-d94bc811-6370-4c57-839e-a3ca2116fe15 req-ea106865-230e-4c2c-a230-ed5265d2bcbf service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:17.998511 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-d94bc811-6370-4c57-839e-a3ca2116fe15 req-ea106865-230e-4c2c-a230-ed5265d2bcbf service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.022281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-d94bc811-6370-4c57-839e-a3ca2116fe15 req-ea106865-230e-4c2c-a230-ed5265d2bcbf service nova] Creating event network-vif-plugged:a4fdf947-4005-4728-8f93-b30af2b7db4b for instance 642fda3b-e6f4-48c5-ba7f-d619553351fd on hv-cinder-83754 Jul 18 16:40:18.034622 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-d94bc811-6370-4c57-839e-a3ca2116fe15 req-ea106865-230e-4c2c-a230-ed5265d2bcbf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065432 Jul 18 16:40:18.054137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 78/141] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:18.098858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:18.099686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:18.112461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.112932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.113739 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.114213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.197074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:18.219125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-566e7159-b525-466e-aa7c-e099e5faae10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.450893 Jul 18 16:40:18.219984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 64/142] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:17 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:18.370527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:18.383662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:18.387055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:18.388770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4d4594df-1c90-46aa-9d6f-eedb10673037 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.299515 Jul 18 16:40:18.389830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 79/143] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:18 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:18.554314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:18.555877 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:18.567922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.569186 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.571138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.572191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.751332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:18.759841 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0c65fd2f-118a-46e7-bc9f-c0e37858ffb6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.213274 Jul 18 16:40:18.760424 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 65/144] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:18 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:18.816468 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:18.817180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:18.823900 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.824382 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.825213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:18.825647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:18.991517 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.005866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bac3ac8a-daff-4752-9a57-f18a0e0356e7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.193192 Jul 18 16:40:19.007004 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 80/145] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:18 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:19.252599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:19.254277 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:19.263478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.263938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.264990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.266245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.422849 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:19.424051 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:19.439121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.440372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.443398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.444455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.466999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.475706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0b0ab24b-f48b-4a44-90ff-de4832898320 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.228463 Jul 18 16:40:19.478976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 66/146] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:19 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:19.628609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.638347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.639909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.641074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-33600fed-51c9-4a20-b040-a951c598a20f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.229012 Jul 18 16:40:19.641661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 81/147] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:19 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:19.777901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:19.778501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:19.785542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.786539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.787402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:19.787834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:19.934669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:19.942628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-89b18909-21eb-4f1c-9f65-3a36fc6651c2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.168687 Jul 18 16:40:19.943155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 67/148] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:19 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:20.027175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:20.027813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:20.034677 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.035023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.036403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.036835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.181912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:20.189781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2b6c4f05-2583-48f2-bab9-e624a4bc0e2f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.166323 Jul 18 16:40:20.190380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 82/149] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:20 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:20.498879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:20.499497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:20.508822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.509272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.510058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.510544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.659905 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:20.660411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:20.666671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.667217 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.668044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.668511 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.684386 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:20.697620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-43e66256-b113-4559-b5f3-6b2b7bbc64ad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.202417 Jul 18 16:40:20.698647 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 68/150] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:20 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:20.834364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:20.849773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:20.852787 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:20.855351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9c9d30c7-e54f-4a47-bf29-21e0118aea7c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.199115 Jul 18 16:40:20.856439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 83/151] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:20 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:20.960805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:20.961453 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:20.967608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.968056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:20.968822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:20.969253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.110495 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:21.119732 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a7b0bfe1-eba8-4fc9-8399-90acfa834e52 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.163023 Jul 18 16:40:21.120321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 69/152] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:20 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:21.206623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:21.207249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:21.213385 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.213750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.214544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.214970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.350181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:21.357755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0a0532d7-5a80-46ca-bcc3-957f3d0ed010 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.154927 Jul 18 16:40:21.358333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 84/153] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:21 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:21.725023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:21.725548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:21.733825 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.734300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.735251 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.735687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.886361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:21.887462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:21.889670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:21.894798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.896143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.897059 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:21.897564 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:21.898519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fdab0d5b-701e-4000-88de-644678d389c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.177975 Jul 18 16:40:21.899133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 70/154] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:21 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:22.044420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:22.053389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:22.055266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:22.056439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-004aacad-bcfc-4c13-b7ca-3dc16000b6fe tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.174931 Jul 18 16:40:22.057009 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 85/155] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:21 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:22.137118 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:22.137959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:22.144316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.144764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:22.146083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.146561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:22.293681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:22.301820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-90c4b888-6389-421a-ab75-fd1a3cefd159 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.168929 Jul 18 16:40:22.302389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 71/156] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:22 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:22.375058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:22.375757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:22.382348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.382830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:22.383619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.384049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:22.536436 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:22.563084 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d0791b2f-e3bc-44b4-843e-892996e0bb87 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1314 microversion: 2.1 time: 0.191334 Jul 18 16:40:22.581167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 86/157] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:22 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:22.918283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:22.919342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:22.926164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.926809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:22.927671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:22.928130 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.075599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:23.076561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:23.084245 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.085056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.086495 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.086947 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.119229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.135249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-76758c38-5d01-40d7-a8d6-72d43fcff3a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.220540 Jul 18 16:40:23.136276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 72/158] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:22 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:23.249286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.258843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.260306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.261408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-660f52d5-3988-4798-b233-0294626c70b9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1407 microversion: 2.20 time: 0.189758 Jul 18 16:40:23.261965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 87/159] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:23 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:40:23.320989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:23.322240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:23.329064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.329748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.330730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.331738 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.527947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.536742 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-61a0cd30-f389-44b4-b7fb-f9f0847fe8cf tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.220812 Jul 18 16:40:23.537576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 73/160] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:23 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:23.588735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:23.590047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:23.598935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.600389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.601398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:23.601834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:23.632354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:23.892126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:23.901095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-283c9801-0e8b-4864-8b77-5c28e5cf90eb tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1500 microversion: 2.1 time: 0.318321 Jul 18 16:40:23.902077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 88/161] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:23 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1500 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:24.160364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:24.167372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:24.176948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.177652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.178786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.179418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.295873 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:24.298805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:24.318707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.319464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.320837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.321612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.467374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:24.477539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9f4dcfee-5850-44e9-a117-9445a4761928 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.326333 Jul 18 16:40:24.479367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 74/162] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:24 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:24.566032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:24.566751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:24.587805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.591880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.593696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.594165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.758645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:24.790924 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:24.794612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:24.798904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-14ebe25d-1791-4240-bbb3-47905e85db92 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1599 microversion: 2.20 time: 0.509473 Jul 18 16:40:24.814748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 89/163] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:40:24 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1599 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:40:24.834683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:24.836066 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:24.849318 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.850657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.852208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:24.852844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:24.950726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:24.970942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-006367b7-7a3d-40b2-bb00-bd58a7b80c70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.409373 Jul 18 16:40:24.974907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 75/164] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:24 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:25.017970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8b56ef8d-b54e-4c44-9862-7458d81b5761 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.190974 Jul 18 16:40:25.020851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 90/165] 10.222.0.77 () {60 vars in 1315 bytes} [Mon Jul 18 16:40:24 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:40:25.508490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:25.511011 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:25.527392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:25.528417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:25.530255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:25.531266 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:25.837679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:25.844195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2b17b41-c90b-498e-a3ab-2c6e9a69c9c6"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:25.846032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:25.861507 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:25.861795 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c7832aa6-a21d-428f-a241-d0d7ef2846a6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.357439 Jul 18 16:40:25.864877 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 76/166] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:25 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:25.866338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:25.867415 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:25.868013 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:26.008302 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:26.011077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:26.023179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:26.025581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:26.029955 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:26.030987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:26.405367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:26.437536 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-06d1cbb6-c909-407d-9ff1-3e6ac1997d40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.439593 Jul 18 16:40:26.438793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 77/167] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:25 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:26.911451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:26.917435 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:26.931883 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:26.933100 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:26.934997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:26.935651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:27.178891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:27.198380 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0c9304c6-307f-416b-985d-fe43d3063161 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.302668 Jul 18 16:40:27.199252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 78/168] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:26 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:27.336058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-e6a08658-e220-4309-94f1-4ca2288dad72 req-64fde6f1-a875-4a89-9d7c-a48cd4134852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:27.347126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e6a08658-e220-4309-94f1-4ca2288dad72 req-64fde6f1-a875-4a89-9d7c-a48cd4134852 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:27.348445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e6a08658-e220-4309-94f1-4ca2288dad72 req-64fde6f1-a875-4a89-9d7c-a48cd4134852 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:27.361501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-e6a08658-e220-4309-94f1-4ca2288dad72 req-64fde6f1-a875-4a89-9d7c-a48cd4134852 service nova] Creating event network-changed:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:40:27.368049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-e6a08658-e220-4309-94f1-4ca2288dad72 req-64fde6f1-a875-4a89-9d7c-a48cd4134852 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041243 Jul 18 16:40:27.368983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 79/169] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:40:27.463513 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:27.467550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:27.486494 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:27.487895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:27.490203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:27.491064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:27.731904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:27.745424 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:27.749397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d91d6041-10ff-4118-926c-98e0ac03e298 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.293264 Jul 18 16:40:27.750401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 80/170] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:27 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:28.218219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:28.219103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:28.231603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:28.232120 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:28.232959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:28.233400 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:28.469195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:28.491677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-eff27907-d4fc-4ecd-bfb4-fa0cb6173bb3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.277624 Jul 18 16:40:28.496789 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 81/171] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:28 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:28.768823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:28.770150 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:28.777127 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:28.777893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:28.779112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:28.779800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:28.951408 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:28.963214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4d945322-31f8-4ad0-a5db-23503b7b0bc6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.199061 Jul 18 16:40:28.963992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 82/172] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:28 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:29.437019 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2bb53fb7-ea3d-4313-a95d-563bf92ade8f tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "POST /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.596343 Jul 18 16:40:29.438959 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 91/173] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:40:25 2022] POST /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7/os-volume_attachments => generated 194 bytes in 3599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:29.524918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:29.525695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:29.546958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:29.548884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:29.552053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:29.556629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:29.873541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:29.888072 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2aa72022-7e89-46c7-b501-5b45859ad908 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1367 microversion: 2.1 time: 0.369461 Jul 18 16:40:29.903583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 83/174] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:29 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:29.997259 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:29.998628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:30.013919 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:30.015755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:30.017527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:30.019320 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:30.338354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:30.360868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d44be9d3-8889-4554-9b23-65e9d6e75488 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.380256 Jul 18 16:40:30.362337 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 92/175] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:29 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:30.916964 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:30.918212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:30.926702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:30.927407 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:30.928181 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:30.928812 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:31.101122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:31.109686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d312cb2e-a289-4543-a4b5-994ec8fcf9b6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1557 microversion: 2.1 time: 0.200161 Jul 18 16:40:31.110278 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 84/176] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:30 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1557 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:31.127937 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:31.128524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:31.135953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:31.136491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:31.137368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:31.137799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:31.228398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1afd319f-784a-49df-8363-c1293b267b4f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105063 Jul 18 16:40:31.229277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 93/177] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:40:31 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:40:31.381589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:31.382597 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:31.390849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:31.391710 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:31.392672 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:31.393423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:31.718536 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:31.730805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-77bb81aa-a0ae-4c5f-afe1-b02311758100 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.355093 Jul 18 16:40:31.731397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 85/178] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:31 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:32.755081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:32.756711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:32.763816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:32.765047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:32.765955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:32.766479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:32.935208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:32.945789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9a6b7a9a-c44e-47c1-b99b-b4a341f8c14f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.195210 Jul 18 16:40:32.946985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 94/179] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:32 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:33.194575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-73223250-9ba7-4991-b741-c597c0383fa5 req-42d3344b-cc7c-47a1-92f2-78f556e1e026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642fda3b-e6f4-48c5-ba7f-d619553351fd", "tag": "a4fdf947-4005-4728-8f93-b30af2b7db4b"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:33.212249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-73223250-9ba7-4991-b741-c597c0383fa5 req-42d3344b-cc7c-47a1-92f2-78f556e1e026 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:33.213242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-73223250-9ba7-4991-b741-c597c0383fa5 req-42d3344b-cc7c-47a1-92f2-78f556e1e026 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:33.236646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-73223250-9ba7-4991-b741-c597c0383fa5 req-42d3344b-cc7c-47a1-92f2-78f556e1e026 service nova] Creating event network-changed:a4fdf947-4005-4728-8f93-b30af2b7db4b for instance 642fda3b-e6f4-48c5-ba7f-d619553351fd on hv-cinder-83754 Jul 18 16:40:33.268768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-73223250-9ba7-4991-b741-c597c0383fa5 req-42d3344b-cc7c-47a1-92f2-78f556e1e026 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080528 Jul 18 16:40:33.270450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 86/180] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:33.963963 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:33.964658 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:33.971435 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:33.971883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:33.972730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:33.973166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:34.147862 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:34.157428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ff3c7dfe-b1d2-44b7-a98d-84d49a9918ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.197566 Jul 18 16:40:34.158319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 95/181] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:33 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:35.183456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:35.184171 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:35.191039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:35.191661 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:35.192517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:35.193000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:35.374498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:35.382950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-780dfac9-29a8-46c0-a16c-df3781a723bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.204075 Jul 18 16:40:35.383544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 87/182] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:35 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:36.399965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:36.400812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:36.408208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:36.408719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:36.409665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:36.410664 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:36.553921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:36.562371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8d142634-9ff4-4e0b-a400-cfac52a26040 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.166632 Jul 18 16:40:36.563169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 96/183] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:36 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:37.585444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:37.586726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:37.607653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:37.608461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:37.609968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:37.610736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:37.812798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:37.821123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-480f81ed-2b61-45ac-a745-4d6319f2a217 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.243726 Jul 18 16:40:37.821711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 88/184] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:37 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:38.840228 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:38.841838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:38.850474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:38.851251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:38.852263 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:38.852889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:39.057566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:39.068900 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b14d101f-139f-47f8-b597-3a17718d41e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.233308 Jul 18 16:40:39.070041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 97/185] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:38 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:40.101498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:40.102884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:40.105140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=82 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:40.112152 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:40.113019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:40.114028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:40.114662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:40.340773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:40.349915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0a3ba286-f970-43e8-9dea-0522888d2a26 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.253811 Jul 18 16:40:40.350898 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 89/186] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:40 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:41.369952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:41.371306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:41.380547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:41.381263 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:41.382718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:41.383343 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:41.643366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:41.652553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e58eba13-64f4-4b25-8012-d1e650d02355 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.287353 Jul 18 16:40:41.653477 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 98/187] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:41 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:42.670310 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:42.671364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:42.680611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:42.681462 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:42.682557 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:42.683389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:42.944849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:42.957447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-87399cc1-9923-4070-8589-1471f31ac2e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.290880 Jul 18 16:40:42.959309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 90/188] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:42 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:43.976707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:43.977462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:43.979801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=62 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:43.985703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:43.986151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:43.986966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:43.987403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:44.153187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:44.161754 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8de106f2-a8b0-4a1f-83f6-91d1a86ea03c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.190325 Jul 18 16:40:44.162388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 99/189] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:43 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:45.179893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:45.180755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:45.188760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:45.189249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:45.190178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:45.190783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:45.349838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:45.359846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-381f201a-9121-48e1-b260-5f5eac4a73ef tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.185245 Jul 18 16:40:45.360707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 91/190] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:45 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:45.908722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1437608219", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "networks": [{"uuid": "2856077e-6a59-46cc-92f1-0b3d4ad6af1f"}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:46.010111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] validate_networks() for [('2856077e-6a59-46cc-92f1-0b3d4ad6af1f', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:40:46.382256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:46.383107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:46.396643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.397083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.397861 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.398292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.567751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:46.571997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:40:46.572419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:40:46.572899 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:40:46.573305 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:40:46.573724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:40:46.576155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dd2f8c88-a105-44dd-a843-395e5e50faa7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.200181 Jul 18 16:40:46.576765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 92/191] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:46 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:46.584837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.585278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.586083 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.586560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.605990 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Getting quotas for project a907861f2aca4a4286e9a46cdae6c4d2. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:40:46.611042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Getting quotas for user 33e56d53506d49a68c864556486c94c4 and project a907861f2aca4a4286e9a46cdae6c4d2. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:40:46.624741 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:40:46.627156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:40:46.678084 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-52dc0e46-be41-4e9f-99b6-dda7bc578b08 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773976 Jul 18 16:40:46.681262 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 100/192] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:40:46.694370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-012d77de-824e-4cfe-87ca-6ce9bbe8df13 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:46.695246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-012d77de-824e-4cfe-87ca-6ce9bbe8df13 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:46.766095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-012d77de-824e-4cfe-87ca-6ce9bbe8df13 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:46.790326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-012d77de-824e-4cfe-87ca-6ce9bbe8df13 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1214 microversion: 2.1 time: 0.101243 Jul 18 16:40:46.792073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 93/193] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:46 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:47.109740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:47.111743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:47.124283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.125101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.126905 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.127744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.171426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:40:47.343666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-aaf70909-7032-48b8-8277-656d8e79b92a tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 204 len: 0 microversion: 2.1 time: 0.239935 Jul 18 16:40:47.344652 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 101/194] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:40:47 2022] DELETE /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:40:47.355294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:47.356145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:47.363664 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.364381 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.365929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.367068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.547317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:47.561071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e1d5bcbe-cb88-493a-9c20-06f54a523d30 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.209937 Jul 18 16:40:47.561902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 94/195] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:47 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:47.603270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:47.603972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:47.611753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.612201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.613011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.613434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.819860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:47.821775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:47.832045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:47.834142 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.834902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.836506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:47.837215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:47.846763 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6537ef84-a0ff-437e-a4b6-357a1ea83181 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.249831 Jul 18 16:40:47.847872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 102/196] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:47 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:47.938465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:47.948838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0096e897-dcfb-43de-97d0-c329c29c34c5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.141462 Jul 18 16:40:47.949561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 95/197] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:47 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:48.586579 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:48.587528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:48.599592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.600156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:48.601285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.601916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:48.633143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:48.776735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:48.785882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7ed03306-e80d-4e93-8ce0-02d9c6783135 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.204790 Jul 18 16:40:48.786796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 103/198] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:48 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:48.873768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:48.874568 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:48.882144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.882623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:48.883584 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.884068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:48.971311 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:48.972847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:48.986959 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.987832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:48.989633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:48.990580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:49.084193 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:49.090219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:49.103113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ead6f396-17b3-4975-ba76-04266df70c75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.139195 Jul 18 16:40:49.103706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 104/199] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:48 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:49.106326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-88c4faa2-5ec4-4345-a1e1-db54dacc62ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.236919 Jul 18 16:40:49.107168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 96/200] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:48 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:49.810850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:49.811461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:49.820298 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:49.820993 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:49.821984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:49.822671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:49.994910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:50.008325 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-64fee66a-14b2-4b59-b829-1b3a9943bc4e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.201247 Jul 18 16:40:50.009105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 105/201] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:49 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:50.149597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:50.150226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:50.152416 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:50.171387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:50.195523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:50.198502 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:50.200486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:50.202809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:50.207911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:50.209058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:50.212404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:50.213395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:50.316269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:50.332808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d432df2d-b6b1-4125-81e5-44837b7cb509 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.204706 Jul 18 16:40:50.336760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 97/202] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:50 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:50.539867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:50.556887 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5bfbdc53-d855-4af0-9441-19f6722a0d81 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.423159 Jul 18 16:40:50.557981 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 106/203] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:50 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:51.030714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:51.031808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:51.040664 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.041434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.042576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.044019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.273667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:51.284140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c2d231c2-2d0c-4bd9-80f9-19ae1ef30b9e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.261470 Jul 18 16:40:51.284958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 98/204] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:51 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:51.356827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:51.357895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:51.367740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.368535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.369549 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.370049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.480447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:51.488447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fbb857bc-150f-4d92-a0e4-79a3f90a02d6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.135860 Jul 18 16:40:51.490131 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 107/205] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:51 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:51.581577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:51.582554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:51.591517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.592524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.593703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:51.594855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:51.599675 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:51.766287 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:51.781081 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6ef628c1-de32-4782-a437-58370b57eb04 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.203675 Jul 18 16:40:51.782079 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 99/206] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:51 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:52.313003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:52.314466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:52.327659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.329030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:52.330832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.331988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:52.517244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:52.518706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:52.530391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.530992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:52.532098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.532680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:52.570924 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:52.592533 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8c8e7d20-a5f2-498f-8cef-c837f2d4abe6 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.290036 Jul 18 16:40:52.599801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 108/207] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:52 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:52.675001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:52.687782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3e5df69-da49-41d2-9079-0c148f1def12 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.184896 Jul 18 16:40:52.688704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 100/208] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:52 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:52.802371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:52.803660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:52.811343 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.811921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:52.812865 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:52.813440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:53.004255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:53.015570 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-14743139-8dda-4bd2-bb2e-b9c4a0746f34 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.217494 Jul 18 16:40:53.016780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 109/209] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:52 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:53.611223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:53.612253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:53.619414 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:53.619847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:53.620614 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:53.621035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:53.711441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:53.712535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:53.722841 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:53.723681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:53.724605 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:53.725277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:53.802653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:53.813146 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-08e2b3f8-f3bd-4d23-9de8-df88276eb96d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.206316 Jul 18 16:40:53.813759 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 101/210] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:53 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:53.826209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:53.834995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6c43f406-821c-4676-9828-0bd7e0bc5d9c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1218 microversion: 2.1 time: 0.130867 Jul 18 16:40:53.835586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 110/211] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:53 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:54.047185 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:54.047818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:54.055071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.055520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.056703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.057149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.300825 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:54.310701 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b24dd40f-39f6-403a-9282-5d6a0f1d40c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.271240 Jul 18 16:40:54.311401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 102/212] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:54 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:54.839842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:54.840585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:54.848297 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.848774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.849653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.850205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.860199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:54.861157 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:54.868322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.868941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.870041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:54.870776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:54.947719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:54.957242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9e4e96d7-bb21-460d-a442-aec11a2ee6bb tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1266 microversion: 2.1 time: 0.102984 Jul 18 16:40:54.958174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 103/213] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:54 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:55.141933 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:55.151282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2424b310-9910-44f2-a544-e08cc5135157 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.314905 Jul 18 16:40:55.151767 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 111/214] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:54 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:55.335170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:55.336103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:55.358778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:55.359794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:55.360901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:55.361570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:55.568030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:55.578006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ed77c021-5060-4d03-b166-d5ae786a310c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.251579 Jul 18 16:40:55.578946 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 104/215] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:55 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:55.976684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:55.977299 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:55.984808 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:55.985246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:55.986062 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:55.986524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:56.056910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:56.064891 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-57714942-d7ae-48ae-b894-0d5635a08577 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1274 microversion: 2.1 time: 0.092172 Jul 18 16:40:56.065477 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 112/216] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:55 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:56.169209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:56.170022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:56.178533 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:56.179031 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:56.180201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:56.180666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:56.343234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:56.354574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c898fe4d-354e-4f2c-bbf6-3a001bcf4a09 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 0.190006 Jul 18 16:40:56.355238 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 105/217] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:56 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:56.602979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:56.604487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:56.610154 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:56.620918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:56.621716 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:56.623952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:56.624100 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:56.624862 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=6 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:57.107924 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:57.110070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:57.114300 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:57.120897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:57.125823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2866a55e-228d-4fe3-a842-b43157de4d2d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.532719 Jul 18 16:40:57.135917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 113/218] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:56 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:57.198707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:57.206647 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:57.209683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:57.211172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:57.380160 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:57.381190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:57.393158 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:57.395288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:57.402452 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:57.403234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:57.505537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:57.525489 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2e4f9508-403a-45ad-8558-0a3ac0bb7b75 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1272 microversion: 2.1 time: 0.443517 Jul 18 16:40:57.526740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 106/219] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:57 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:40:58.067292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-388f7c5e-674d-43ce-8d02-3abcf13f9fd3 req-05a7ddd1-1600-4045-8c6a-44a8de25ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7", "name": "network-vif-unplugged", "status": "completed", "tag": "3cef60a6-8b3b-4cfe-9cec-c800df0d9278"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:58.097764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-388f7c5e-674d-43ce-8d02-3abcf13f9fd3 req-05a7ddd1-1600-4045-8c6a-44a8de25ea5d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:58.099211 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-388f7c5e-674d-43ce-8d02-3abcf13f9fd3 req-05a7ddd1-1600-4045-8c6a-44a8de25ea5d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:58.155996 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-388f7c5e-674d-43ce-8d02-3abcf13f9fd3 req-05a7ddd1-1600-4045-8c6a-44a8de25ea5d service nova] Creating event network-vif-unplugged:3cef60a6-8b3b-4cfe-9cec-c800df0d9278 for instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 on hv-cinder-83754 Jul 18 16:40:58.176933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-388f7c5e-674d-43ce-8d02-3abcf13f9fd3 req-05a7ddd1-1600-4045-8c6a-44a8de25ea5d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120926 Jul 18 16:40:58.180395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 107/220] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:40:58.224765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:58.229305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:58.262984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:58.268052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:58.272956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:58.273845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:58.502277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:58.513071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:58.519146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-10e5c8a8-9227-4675-89e2-dcd24a28745c tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1552 microversion: 2.1 time: 1.143080 Jul 18 16:40:58.520565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 114/221] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:57 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1552 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:58.522243 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c5059542-d79a-45a8-8bc6-56f8dea165a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.330483 Jul 18 16:40:58.522871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 108/222] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:58 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:58.554815 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:58.556050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:58.564687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:58.565260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:58.566697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:58.567409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:58.943552 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:58.953691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7436803a-bee4-4106-ab09-f0a92713a75d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.403805 Jul 18 16:40:58.954498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 115/223] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:58 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:59.116079 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-789852ec-dfb1-4b46-a00f-2c89114b4999 req-7b8ade9b-c239-4a87-83e3-d18d47da929a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7", "name": "network-vif-deleted", "tag": "3cef60a6-8b3b-4cfe-9cec-c800df0d9278"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:40:59.135349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-789852ec-dfb1-4b46-a00f-2c89114b4999 req-7b8ade9b-c239-4a87-83e3-d18d47da929a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:59.136549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-789852ec-dfb1-4b46-a00f-2c89114b4999 req-7b8ade9b-c239-4a87-83e3-d18d47da929a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:59.163198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-789852ec-dfb1-4b46-a00f-2c89114b4999 req-7b8ade9b-c239-4a87-83e3-d18d47da929a service nova] Creating event network-vif-deleted:3cef60a6-8b3b-4cfe-9cec-c800df0d9278 for instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 on hv-cinder-83754 Jul 18 16:40:59.173364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-789852ec-dfb1-4b46-a00f-2c89114b4999 req-7b8ade9b-c239-4a87-83e3-d18d47da929a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065195 Jul 18 16:40:59.175315 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 109/224] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:59.564163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:59.567283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:59.568566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:59.570195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:40:59.605968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:59.607030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:59.609584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:59.610639 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:59.629659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:59.632807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:59.641683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:59.646233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:59.926827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:40:59.968438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7f433b19-0d47-43e1-84eb-0cd98f1d26ab tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1345 microversion: 2.1 time: 0.418374 Jul 18 16:40:59.969697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 116/225] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:59 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1345 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:40:59.990904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:59.992251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:00.000280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:00.000720 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:00.001724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:00.002157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:00.075880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:00.084637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-46deee3f-7e1a-4700-868a-84813cf9c832 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1522 microversion: 2.1 time: 0.539698 Jul 18 16:41:00.085321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 110/226] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:59 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:00.247225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:00.258970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5fc126cb-fde3-4878-b12e-b265fb52cbaf tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.285379 Jul 18 16:41:00.259976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 117/227] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:40:59 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:01.000446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:01.001886 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:01.009449 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.010008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.011378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.012024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.086089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:01.101314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-44d7d666-5f56-4313-9664-2accf789f9ba tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1345 microversion: 2.1 time: 0.107202 Jul 18 16:41:01.103270 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 111/228] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:00 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:01.112167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:01.113002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:01.120012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.120670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.121610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.122191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.211558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-b7f6670d-3a21-4e91-83fc-819dc4a30b7d req-6695a457-a2f8-443b-9437-d103b17fab04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c78918-81a7-4ed7-adbf-3768ca9f0e17", "tag": "4098102a-e5a7-477a-be7a-09cc672f1f51"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:01.225687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-b7f6670d-3a21-4e91-83fc-819dc4a30b7d req-6695a457-a2f8-443b-9437-d103b17fab04 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.226435 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-b7f6670d-3a21-4e91-83fc-819dc4a30b7d req-6695a457-a2f8-443b-9437-d103b17fab04 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.247543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-b7f6670d-3a21-4e91-83fc-819dc4a30b7d req-6695a457-a2f8-443b-9437-d103b17fab04 service nova] Creating event network-changed:4098102a-e5a7-477a-be7a-09cc672f1f51 for instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 on hv-cinder-83754 Jul 18 16:41:01.259685 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-b7f6670d-3a21-4e91-83fc-819dc4a30b7d req-6695a457-a2f8-443b-9437-d103b17fab04 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054228 Jul 18 16:41:01.261261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 112/229] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:01.289840 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:01.296370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:01.303864 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.304985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.306332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.306957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.309634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:01.319761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7eb48920-2a74-4ca9-bab1-839a35212ca8 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1502 microversion: 2.1 time: 0.211453 Jul 18 16:41:01.320622 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 118/230] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:01 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:01.349479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:01.350676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:01.362913 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.363674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.365080 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:01.365834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:01.462312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:01.475385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e97ff242-72e3-4272-a366-bd9b6a29abb5 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.193739 Jul 18 16:41:01.476131 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 113/231] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:01 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:01.550266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:01.559309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7764ad64-d688-486b-b2f3-414e4e453318 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1515 microversion: 2.1 time: 0.217126 Jul 18 16:41:01.559964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 119/232] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:01 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:02.121683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:02.122326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:02.129546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:02.129984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:02.130794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:02.131220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:02.197960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:02.207041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e1aad3b4-38c0-42ff-9fbc-84b6d348cc9d tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1345 microversion: 2.1 time: 0.089097 Jul 18 16:41:02.207630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 114/233] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:02 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:02.501358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:02.501898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:02.510151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:02.510636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:02.511439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:02.511874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:02.516754 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:02.664200 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:02.672321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9a6b9f55-193e-4720-bf2a-fd9fca617bb0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.175071 Jul 18 16:41:02.672901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 120/234] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:02 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:03.224219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:03.224799 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:03.231310 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:03.231911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:03.232902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:03.233484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:03.305238 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:03.320553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-81e45698-3405-49b8-8697-f3a84a5420c7 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1345 microversion: 2.1 time: 0.100457 Jul 18 16:41:03.321536 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 115/235] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:03 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:03.691001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:03.691737 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:03.700497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:03.700935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:03.701731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:03.702191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:03.951857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:03.964804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b0890245-910e-4d56-9298-0f44694f75e0 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.278024 Jul 18 16:41:03.966024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 121/236] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:03 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:04.338280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:04.339151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:04.346898 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:04.347431 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:04.348376 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:04.348924 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:04.419483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:04.431097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7c38707c-7907-4b67-ac8e-de821bd287cf tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1345 microversion: 2.1 time: 0.096722 Jul 18 16:41:04.432021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 116/237] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:04 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:04.989978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:04.990684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:04.998124 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:04.998621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:04.999462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:04.999938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:05.168907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:05.180309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0a6015ee-12de-4664-865a-ccea6aa0a4db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.194391 Jul 18 16:41:05.181249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 122/238] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:04 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:05.463265 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:05.464522 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:05.475086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:05.478173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:05.480334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:05.481596 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:05.567021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:05.567021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:05.567021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lazy-loading 'fault' on Instance uuid e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:05.569731 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:05.632130 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:05.643681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fd34862d-b6c8-42bf-8f8c-95dbc6086b49 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1350 microversion: 2.1 time: 0.190682 Jul 18 16:41:05.644749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 117/239] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:05 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:06.200519 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:06.201194 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:06.209256 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:06.209695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:06.210500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:06.210933 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:06.361320 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:06.369694 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c3029845-9c89-45ee-a2fb-fe90879db29a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.172930 Jul 18 16:41:06.370316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 123/240] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:06 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:06.670218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:06.671006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:06.681051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:06.681807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:06.683165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:06.683917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:06.744078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:06.744844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:06.745615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lazy-loading 'fault' on Instance uuid e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:06.798111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:06.806887 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4e9d91cc-888f-4c1b-acbc-edb7c2f9387e tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1350 microversion: 2.1 time: 0.140995 Jul 18 16:41:06.807468 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 118/241] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:06 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:07.386916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:07.387480 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:07.394736 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:07.395222 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:07.396015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:07.396446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:07.536171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:07.544845 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6162afba-ad4b-4413-bc5a-c594aa3fe9be tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.161965 Jul 18 16:41:07.545440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 124/242] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:07 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:07.824066 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:07.824701 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:07.831325 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:07.831772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:07.832553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:07.832990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:07.866962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:07.867427 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:07.867878 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lazy-loading 'fault' on Instance uuid e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:07.913506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:07.921976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f6380e2c-84d2-4185-a902-1900d1527328 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1350 microversion: 2.1 time: 0.101746 Jul 18 16:41:07.922601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 119/243] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:07 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:08.258750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:08.259806 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:08.266764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.267209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.268485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.268912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.294299 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'flavor' on Instance uuid 5818de22-86dc-4174-86ff-b7e7d2873b35 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:08.378828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4cf493e4-aaf8-4aba-bc39-2265879f595c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/action" status: 200 len: 32 microversion: 2.1 time: 0.124194 Jul 18 16:41:08.379493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 125/244] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:41:08 2022] POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:41:08.388937 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:08.389564 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:08.397000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.397642 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.398677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.399286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.541108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:08.549306 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d869a158-a207-4bae-bb49-c02d6fa0fd14 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.164275 Jul 18 16:41:08.550013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 120/245] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:08 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:08.565990 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:08.566785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:08.573663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.574162 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.575034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.575521 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.772136 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:08.800190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-671dc48a-7bb6-4c57-8971-1c27cf165596 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.240235 Jul 18 16:41:08.801109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 126/246] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:08 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:08.942174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:08.943069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:08.975922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.976925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:08.984280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:08.985203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:09.034520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:09.035227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:09.035889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lazy-loading 'fault' on Instance uuid e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:09.093476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a0fa5ed18f2499488e01dd95a65194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d4c19f14be46208297e4e3fb854bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:09.109462 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-805efc22-725b-478d-bdcf-8340d772f4d3 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 200 len: 1350 microversion: 2.1 time: 0.172525 Jul 18 16:41:09.117786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 121/247] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:08 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:09.569486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:09.570092 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:09.576778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:09.577221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:09.578001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:09.578467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:09.734811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:09.743304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d2e9f3fc-4022-4087-8584-f0bd05fb98cd tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.178131 Jul 18 16:41:09.743891 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 127/248] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:09 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:09.829261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:09.830705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:09.841217 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:09.841879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:09.842890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:09.843822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.107219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:10.116831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1699c4d8-14fe-44ff-b3d3-3549a7637d6c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.295466 Jul 18 16:41:10.120360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 122/249] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:09 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:10.141283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:10.142878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:10.155774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.157118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.159868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.160453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.185910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] HTTP exception thrown: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Request method failure captured: Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 HTTP/1.1 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy-o0xo1AkNgY8pdvfnlyMfURTSir6xDQ8iOX9Iof-knet6EhunoM90AxV-ICDuWJmga9fW5PbnCyw4ExbdjmeCdxQie9P2Ec8YrVCuELFsObp_WWERhKeqLlwuG3sezNrT1_wn7kr8-tsT2yZXyzzq0Ge8RazoHuX3B54Mu-AgWuE Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:41:10.200989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_49d4c19f14be46208297e4e3fb854bb0", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a0fa5ed18f2499488e01dd95a65194d Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.202707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7'} Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:10.203472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.204712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.205826 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Returning 404 to user: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:10.205826 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6349c9ef-6d2a-46f8-8c84-b6db0673c035 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 404 len: 111 microversion: 2.1 time: 0.071622 Jul 18 16:41:10.209345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 128/250] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:10 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:10.436190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:10.437212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:10.439425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=78 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:10.445084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.445592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.446348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.446818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.499948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] HTTP exception thrown: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Request method failure captured: Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7/os-volume_attachments HTTP/1.1 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy-o0xo1AkNgY8pdvfnlyMfURTSir6xDQ8iOX9Iof-knet6EhunoM90AxV-ICDuWJmga9fW5PbnCyw4ExbdjmeCdxQie9P2Ec8YrVCuELFsObp_WWERhKeqLlwuG3sezNrT1_wn7kr8-tsT2yZXyzzq0Ge8RazoHuX3B54Mu-AgWuE Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:41:10.504164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_49d4c19f14be46208297e4e3fb854bb0", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4a0fa5ed18f2499488e01dd95a65194d Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.506475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'server_id': 'e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7'} Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:10.507835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:10.509897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:10.512382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Returning 404 to user: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:10.512382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8f7c3129-1569-4b16-a84a-5357dbd77e98 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073715 Jul 18 16:41:10.512382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 123/251] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:41:10 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7/os-volume_attachments => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:10.764752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:10.765828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:10.777016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.777609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.778967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:10.780169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:10.945372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:10.954691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-32c90f27-b202-42b1-8024-0982baea8083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.194726 Jul 18 16:41:10.956117 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 129/252] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:10 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:11.135129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:11.135680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:11.142129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.142607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.143396 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.143818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.321124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:11.328845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5c3199ab-aec9-412c-a974-6b580455a493 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.197713 Jul 18 16:41:11.329428 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 124/253] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:11 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:11.793188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:11.793795 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:11.801872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.802319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.803149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.803576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.823340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] HTTP exception thrown: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Request method failure captured: Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 HTTP/1.1 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy-o0xo1AkNgY8pdvfnlyMfURTSir6xDQ8iOX9Iof-knet6EhunoM90AxV-ICDuWJmga9fW5PbnCyw4ExbdjmeCdxQie9P2Ec8YrVCuELFsObp_WWERhKeqLlwuG3sezNrT1_wn7kr8-tsT2yZXyzzq0Ge8RazoHuX3B54Mu-AgWuE Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:41:11.828202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_49d4c19f14be46208297e4e3fb854bb0", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4a0fa5ed18f2499488e01dd95a65194d Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.831031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7'} Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:11.832322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.834491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.836568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Returning 404 to user: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:11.836568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1475714f-61ac-4766-bbfd-1dc2a7083f50 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 404 len: 111 microversion: 2.1 time: 0.041259 Jul 18 16:41:11.836568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 130/254] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:41:11 2022] DELETE /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:11.842650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:11.843394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] [instance: e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:11.853995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.854589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.856474 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.857541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.875480 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] HTTP exception thrown: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Request method failure captured: Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 HTTP/1.1 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy-o0xo1AkNgY8pdvfnlyMfURTSir6xDQ8iOX9Iof-knet6EhunoM90AxV-ICDuWJmga9fW5PbnCyw4ExbdjmeCdxQie9P2Ec8YrVCuELFsObp_WWERhKeqLlwuG3sezNrT1_wn7kr8-tsT2yZXyzzq0Ge8RazoHuX3B54Mu-AgWuE Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:41:11.877629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_49d4c19f14be46208297e4e3fb854bb0", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/49d4c19f14be46208297e4e3fb854bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 49d4c19f14be46208297e4e3fb854bb0 Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1556472954 Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4a0fa5ed18f2499488e01dd95a65194d Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-DeleteServersTestJSON-1556472954-project Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.879558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': 'e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7'} Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:11.880519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. Jul 18 16:41:11.882320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:11.884537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] Returning 404 to user: Instance e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:11.884537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0cf23b17-a44f-401d-a094-ebe8be601930 tempest-DeleteServersTestJSON-1556472954 tempest-DeleteServersTestJSON-1556472954-project] 10.222.0.77 "GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7" status: 404 len: 111 microversion: 2.1 time: 0.040608 Jul 18 16:41:11.884537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 125/255] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:11 2022] GET /compute/v2.1/servers/e83e9ae3-565a-4c4c-9bce-20e19fa3a1e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:11.978370 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:11.979923 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:11.993065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.993898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:11.995662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:11.996659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:12.090063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-7f9838ca-77d3-4ac4-b7e6-232e1b439561 req-9549dd48-0d7c-439a-a910-dc528721d8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c78918-81a7-4ed7-adbf-3768ca9f0e17", "name": "network-vif-plugged", "status": "completed", "tag": "4098102a-e5a7-477a-be7a-09cc672f1f51"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:12.107873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7f9838ca-77d3-4ac4-b7e6-232e1b439561 req-9549dd48-0d7c-439a-a910-dc528721d8e7 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:12.108671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7f9838ca-77d3-4ac4-b7e6-232e1b439561 req-9549dd48-0d7c-439a-a910-dc528721d8e7 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:12.123176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-7f9838ca-77d3-4ac4-b7e6-232e1b439561 req-9549dd48-0d7c-439a-a910-dc528721d8e7 service nova] Creating event network-vif-plugged:4098102a-e5a7-477a-be7a-09cc672f1f51 for instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 on hv-cinder-83754 Jul 18 16:41:12.136546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-7f9838ca-77d3-4ac4-b7e6-232e1b439561 req-9549dd48-0d7c-439a-a910-dc528721d8e7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050244 Jul 18 16:41:12.138740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 126/256] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:41:12.260821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:12.272081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-adeb3d7d-4055-4edb-878c-f552ce5b3ece tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.301814 Jul 18 16:41:12.272984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 131/257] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:11 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:12.347956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:12.349074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:12.357303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:12.360151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:12.361623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:12.362394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:12.600746 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:12.612340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e7c02e69-3d2c-407c-9e10-d7651d06d152 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.268911 Jul 18 16:41:12.612955 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 127/258] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:12 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:13.294793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:13.295474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:13.303031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:13.303482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:13.304653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:13.305163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:13.533234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:13.547556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3623db66-2a96-4b88-b6df-198009c06954 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.256253 Jul 18 16:41:13.548668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 132/259] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:13 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:13.638900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:13.639592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:13.647516 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:13.648438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:13.649632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:13.650226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:13.992895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:14.002847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6b2afd0c-d0af-41d6-af25-b53db7dd1c86 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1314 microversion: 2.1 time: 0.368421 Jul 18 16:41:14.004307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 128/260] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:13 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:14.569592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:14.571687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:14.584960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:14.597628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:14.598638 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:14.599671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:14.600266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:15.025113 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:15.027501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:15.052412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:15.053476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:15.055916 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:15.056552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:15.363968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:15.385242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4a330d96-5017-4b32-b070-a1d458a96135 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.822318 Jul 18 16:41:15.392029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 133/261] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:14 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:15.416296 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:15.431728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f8224bdc-085a-4c20-8434-501ec1b47b19 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1499 microversion: 2.1 time: 0.414065 Jul 18 16:41:15.433972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 129/262] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:15 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1499 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:16.425018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:16.426023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:16.429775 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:16.430577 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:16.441680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.442122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:16.445176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.445585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:16.446751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.448062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:16.449140 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.452467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:16.522395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:41:16.790699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:16.801960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9a8197ad-adc9-422c-8904-baa88cdeaf6b tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "DELETE /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 204 len: 0 microversion: 2.1 time: 0.380204 Jul 18 16:41:16.803451 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-339206e6-669f-463b-99e9-76376e325cdb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.385112 Jul 18 16:41:16.804274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 134/263] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:16 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:16.832470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 130/264] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:41:16 2022] DELETE /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:41:16.843581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:16.843581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:16.869551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.870022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:16.870821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:16.871255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:17.297743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:17.312181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-332c93a6-8104-42d5-aab0-05aa537264de tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1505 microversion: 2.1 time: 0.472218 Jul 18 16:41:17.313589 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 135/265] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:16 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:17.836378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:17.837705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:17.880725 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:17.885398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:17.887674 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:17.889270 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:18.319814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:18.332203 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:18.332746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:18.344226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3497a23-e03f-4de4-822d-e3990584b3fc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.517469 Jul 18 16:41:18.344820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 131/266] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:17 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:18.347329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:18.348272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:18.350024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:18.351428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:18.421426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:18.695273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:18.729433 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f8ea1766-28c7-4d9e-bf3f-934a328b658d tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1505 microversion: 2.1 time: 0.401889 Jul 18 16:41:18.771706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 136/267] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:18 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:19.363592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:19.364776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:19.375053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:19.375893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:19.377495 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:19.378204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:19.643562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:19.662208 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-96ca3e4f-af4d-4994-bae9-187d2edaec20 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.304726 Jul 18 16:41:19.672460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 132/268] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:19 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:19.762241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:19.764804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:19.796477 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:19.799528 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:19.803127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:19.810940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:20.149485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-36062573-3f24-4965-808d-2835a55a0ddd req-8db98b0d-5679-4ca4-b13f-e115a8e9b795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c78918-81a7-4ed7-adbf-3768ca9f0e17", "name": "network-vif-deleted", "tag": "4098102a-e5a7-477a-be7a-09cc672f1f51"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:20.168733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-36062573-3f24-4965-808d-2835a55a0ddd req-8db98b0d-5679-4ca4-b13f-e115a8e9b795 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:20.169708 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-36062573-3f24-4965-808d-2835a55a0ddd req-8db98b0d-5679-4ca4-b13f-e115a8e9b795 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:20.190687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-36062573-3f24-4965-808d-2835a55a0ddd req-8db98b0d-5679-4ca4-b13f-e115a8e9b795 service nova] Creating event network-vif-deleted:4098102a-e5a7-477a-be7a-09cc672f1f51 for instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 on hv-cinder-83754 Jul 18 16:41:20.209989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:20.215912 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-36062573-3f24-4965-808d-2835a55a0ddd req-8db98b0d-5679-4ca4-b13f-e115a8e9b795 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069905 Jul 18 16:41:20.234337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 133/269] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:41:20.235307 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1d926f18-8a87-4d2b-9fda-d9017e1966ad tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1505 microversion: 2.1 time: 0.478792 Jul 18 16:41:20.236750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 137/270] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:19 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:20.688228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:20.690987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:20.707995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:20.709030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:20.711048 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:20.711746 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:20.717091 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:20.950670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:20.959996 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b4210d52-50e0-479d-9fab-893160692ab1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.281955 Jul 18 16:41:20.974012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 134/271] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:20 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:21.267286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:21.269277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:21.286496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:21.300243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:21.301090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:21.301544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:21.441075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:21.459547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5f176026-659b-466d-918a-0355c7e2baba tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 200 len: 1299 microversion: 2.1 time: 0.198693 Jul 18 16:41:21.460713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 138/272] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:21 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:21.991434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:21.995925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:22.020543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:22.021349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:22.024215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:22.025072 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:22.317835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:22.328833 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-062717fe-7cc6-4735-b4aa-3e8729118fca tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.350158 Jul 18 16:41:22.329522 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 135/273] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:21 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:22.478296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:22.479025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 09c78918-81a7-4ed7-adbf-3768ca9f0e17] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:22.487329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:22.487782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:22.490381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:22.491353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:22.512662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] HTTP exception thrown: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Request method failure captured: Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 HTTP/1.1 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y0K6mwGRZdDreLdZRKgDDn2PkzIzr7W0rdgkNCjrcys9vkBotGYmdHloEe5SXJQ8yRVSx3iDX9OOviOFmWz1aHOV14f5v7DbOrQ0X106rA1qv_P0rXl03rH8dtha2r6x0QARvdepb5_RGLxi6HNFItNgzVtWPgtAxwVI0LZXSAdAQg Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: a907861f2aca4a4286e9a46cdae6c4d2 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:41:22.514241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_a907861f2aca4a4286e9a46cdae6c4d2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: a907861f2aca4a4286e9a46cdae6c4d2 Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesActionsTest-2097345895-project Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 33e56d53506d49a68c864556486c94c4 Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesActionsTest-2097345895-project Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. Jul 18 16:41:22.515786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '09c78918-81a7-4ed7-adbf-3768ca9f0e17'} Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:22.516530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. Jul 18 16:41:22.518215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:22.521113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Returning 404 to user: Instance 09c78918-81a7-4ed7-adbf-3768ca9f0e17 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:22.522044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0898f5ff-8224-4fda-b8e6-0bf9b993b924 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17" status: 404 len: 111 microversion: 2.1 time: 0.047834 Jul 18 16:41:22.523331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 139/274] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:22 2022] GET /compute/v2.1/servers/09c78918-81a7-4ed7-adbf-3768ca9f0e17 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:22.815506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1778872624", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "networks": [{"uuid": "2856077e-6a59-46cc-92f1-0b3d4ad6af1f"}]}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:22.936823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] validate_networks() for [('2856077e-6a59-46cc-92f1-0b3d4ad6af1f', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:41:23.356640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:23.357674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:23.377503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:23.378368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:23.379406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:23.379919 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:23.517973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:41:23.519706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:41:23.520814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:41:23.521673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:41:23.522755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:41:23.538632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:23.539319 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:23.541437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:23.542174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:23.571233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Getting quotas for project a907861f2aca4a4286e9a46cdae6c4d2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:41:23.576847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Getting quotas for user 33e56d53506d49a68c864556486c94c4 and project a907861f2aca4a4286e9a46cdae6c4d2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:41:23.592406 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:41:23.596069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:41:23.608784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:23.625553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-429707c2-ee37-48c8-902c-ba1971b34a7d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.272403 Jul 18 16:41:23.640623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 140/275] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:23 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:23.664952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dbbe1b44-7a4a-4285-99f2-d0ac93ebc4bc tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859817 Jul 18 16:41:23.665811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 136/276] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:41:23.676646 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cd7d176e-f296-4d6b-b604-d5a8cfaf1a97 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:23.679770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cd7d176e-f296-4d6b-b604-d5a8cfaf1a97 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:23.777071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd7d176e-f296-4d6b-b604-d5a8cfaf1a97 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:23.791420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cd7d176e-f296-4d6b-b604-d5a8cfaf1a97 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1214 microversion: 2.1 time: 0.119015 Jul 18 16:41:23.792916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 141/277] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:23 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:24.650921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:24.651787 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:24.669154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.670255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:24.671474 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.672260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:24.814802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:24.817069 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:24.832357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.833207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:24.834608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.835496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:24.928205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:24.929098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:24.939174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-66d94bf6-a5d6-4c28-8036-18f849317f36 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1501 microversion: 2.1 time: 0.293828 Jul 18 16:41:24.939399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-421ffbd9-513b-42b0-b8c8-e7f2bd61b061 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1266 microversion: 2.1 time: 0.133335 Jul 18 16:41:24.939890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 137/278] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:24 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:24.940304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 142/279] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:24 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:24.956216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1744d26-8b1d-4199-bf49-917982c05bad"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:24.957447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:24.966700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.968104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:24.970855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:24.971733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.003021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] HTTP exception thrown: Cannot 'attach_volume' instance 5818de22-86dc-4174-86ff-b7e7d2873b35 while it is in vm_state rescued Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Request method failure captured: Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/os-volume_attachments HTTP/1.1 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 74 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy1eX-DjPkyYdfnoJYxaGVNuSu5eYPnaCDDJiLy71EiuUZ5EroXnuvt9Lbnqb_iJPqF6LMIxC35i6j-CjWZ5IeuSN5G7juDyVJl7fFX5mn1dyYmq52fmfXDa_SzJgi3hM7Ut-o955Ff2WciO_ZQOnmk2xLGDuskaOC_u2TuJu_Qq1E Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:41:25.007099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/afb65421f9504a918b7a47451fac6707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_afb65421f9504a918b7a47451fac6707", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: ab3be59ea4c74da3b4e19273102bccd9 Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {"volumeAttachment": {"volumeId": "f1744d26-8b1d-4199-bf49-917982c05bad"}} Jul 18 16:41:25.008934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Cannot 'attach_volume' instance 5818de22-86dc-4174-86ff-b7e7d2873b35 while it is in vm_state rescued Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'server_id': '5818de22-86dc-4174-86ff-b7e7d2873b35', 'body': {'volumeAttachment': {'volumeId': 'f1744d26-8b1d-4199-bf49-917982c05bad'}}} Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:25.010231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5818de22-86dc-4174-86ff-b7e7d2873b35 while it is in vm_state rescued Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:25.011437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:25.012608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:25.012608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:25.012608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5818de22-86dc-4174-86ff-b7e7d2873b35 while it is in vm_state rescued Jul 18 16:41:25.012608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:41:25.014550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Returning 409 to user: Cannot 'attach_volume' instance 5818de22-86dc-4174-86ff-b7e7d2873b35 while it is in vm_state rescued {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:25.015960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dc1eba39-1db9-4807-8297-153d1a770322 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063640 Jul 18 16:41:25.016694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 138/280] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:41:24 2022] POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:41:25.027324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:25.028303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:25.037202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.038193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.039717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.040737 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.135063 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8f1bfed7-b245-46f9-bd02-984dbad5a03d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/action" status: 202 len: 0 microversion: 2.1 time: 0.112650 Jul 18 16:41:25.135708 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 143/281] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:41:25 2022] POST /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:41:25.148292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:25.149734 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:25.160628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.161469 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.163025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.163784 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.371668 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:25.380786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-83a3b067-1451-4301-a69e-5cfa9727beb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.240308 Jul 18 16:41:25.382441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 139/282] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:25 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:25.961062 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:25.962952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:25.973211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.974930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:25.976053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:25.976786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:26.106631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:26.116165 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f6d2e7da-9bdd-40ce-8085-9dd23fe033b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1272 microversion: 2.1 time: 0.160014 Jul 18 16:41:26.117951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 144/283] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:25 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:26.400151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:26.400771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:26.413093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:26.413599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:26.417357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:26.417974 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:26.630616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:26.645483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1ea22b19-a8b3-47a1-bc5e-1e4ea257f47e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.249757 Jul 18 16:41:26.647032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 140/284] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:26 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:27.142739 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:27.143417 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:27.150225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:27.150714 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:27.151566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:27.151905 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:27.304559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:27.314955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-68298b7e-8cda-4e6e-a739-a52d85726db3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.177144 Jul 18 16:41:27.315548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 145/285] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:27 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:27.668762 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:27.669608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:27.678788 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:27.679388 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:27.680538 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:27.681085 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:27.878040 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:27.886694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9db530ee-a8e0-40d0-a5b8-8b9772466dd0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.223723 Jul 18 16:41:27.894486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 141/286] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:27 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:28.333824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:28.334696 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:28.344783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:28.345651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:28.347376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:28.348156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:28.581864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:28.589730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1f73cb2d-ff72-422b-b971-e0635b89e20c tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.261438 Jul 18 16:41:28.590681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 146/287] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:28 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:28.907377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:28.908264 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:28.914759 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:28.915290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:28.916060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:28.916492 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:29.060840 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:29.069616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7e046650-9531-440b-b99a-6e9513fe6bed tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.166003 Jul 18 16:41:29.070214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 142/288] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:28 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:29.609875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:29.610568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:29.617999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:29.618475 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:29.619470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:29.619905 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:29.902057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:29.921594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ccd6efdb-337c-45eb-926c-a9839bf29652 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.316302 Jul 18 16:41:29.923329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 147/289] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:29 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:30.100425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:30.101537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:30.120622 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:30.121913 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:30.123648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:30.124707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:30.345188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-03c1bb9b-9fa2-44b8-93bc-0b9e37285c06 req-296689ef-f947-49d7-bc7f-f85d482bf18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02afaf37-c2d4-47bc-b4d1-dcd5d1539128", "tag": "7d2fb95f-9875-4fbf-a12a-413fd22ef8b7"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:30.381284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:30.393434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-723221ba-ba11-4787-bea3-20190fca9258 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.306744 Jul 18 16:41:30.396808 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-03c1bb9b-9fa2-44b8-93bc-0b9e37285c06 req-296689ef-f947-49d7-bc7f-f85d482bf18b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:30.397438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-03c1bb9b-9fa2-44b8-93bc-0b9e37285c06 req-296689ef-f947-49d7-bc7f-f85d482bf18b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:30.410518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 143/290] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:30 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:30.414038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-03c1bb9b-9fa2-44b8-93bc-0b9e37285c06 req-296689ef-f947-49d7-bc7f-f85d482bf18b service nova] Creating event network-changed:7d2fb95f-9875-4fbf-a12a-413fd22ef8b7 for instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 on hv-cinder-83754 Jul 18 16:41:30.421556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-03c1bb9b-9fa2-44b8-93bc-0b9e37285c06 req-296689ef-f947-49d7-bc7f-f85d482bf18b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084813 Jul 18 16:41:30.422509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 148/291] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:30.940075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:30.940676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:30.946840 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:30.947286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:30.948072 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:30.948507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:31.088962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:31.098775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dc391e34-d381-436e-8105-dab583ecb498 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.162605 Jul 18 16:41:31.099834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 144/292] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:30 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:31.421314 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:31.422590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:31.434047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:31.435149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:31.436607 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:31.437287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:31.682936 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:31.693097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-be6e0fc9-a959-499c-ab4b-45e7fde507a2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1509 microversion: 2.1 time: 0.276802 Jul 18 16:41:31.693943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 149/293] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:31 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:32.128722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:32.129987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:32.136633 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.137411 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.138221 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.138772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.166251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:32.166786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:32.176274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.176726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.180532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.180983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.225661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d31a639f-0e48-4e88-bede-a54d2dfc0f39 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/ips" status: 200 len: 149 microversion: 2.1 time: 0.063555 Jul 18 16:41:32.235375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 150/294] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:41:32 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:41:32.352169 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:32.360198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-046690a0-8cbe-42bc-a362-f944c2e158f6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.241277 Jul 18 16:41:32.367528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 145/295] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:32 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:32.713883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:32.714837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:32.724523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.724987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.726166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:32.726803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:32.972771 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:32.981959 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-15389058-0be2-47d9-b3a5-9f95c3256b40 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1515 microversion: 2.1 time: 0.272309 Jul 18 16:41:32.982860 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 151/296] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:32 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:33.386477 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:33.388174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:33.406800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:33.409345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:33.411535 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:33.411535 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:33.559478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:33.591145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=6 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:33.611253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:33.624499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-39d35552-ad98-44c7-9340-19f7e69ed170 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.243963 Jul 18 16:41:33.626149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 146/297] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:33 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:33.740155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54f72d9f-e10c-4187-a122-dfb7feaa2c07"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:33.741287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:33.749604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:33.750552 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:33.751494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:33.752058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:33.785510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:34.503929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0831b67c-09ed-43a2-b53c-594eb9c0a280 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: .version_select at 0x7fc3a2158670>, body: {"keypair": {"name": "tempest-keypair-982414460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClhqir5dUTl91NFQLUqSXEGGwXFzQ305MCMtASJ8a4l5IqM+RgnSks5nlY4kafnGLyiswbbdAXAHJOzqvIjBsFLYFDxBngxedHbyxixHvPLuVq9izz6KDwkigo7v4HSeA=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:34.519190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-0831b67c-09ed-43a2-b53c-594eb9c0a280 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for project afb65421f9504a918b7a47451fac6707. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:41:34.524383 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-0831b67c-09ed-43a2-b53c-594eb9c0a280 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for user ab3be59ea4c74da3b4e19273102bccd9 and project afb65421f9504a918b7a47451fac6707. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:41:34.554510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0831b67c-09ed-43a2-b53c-594eb9c0a280 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055736 Jul 18 16:41:34.555353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 147/298] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:41:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:34.671845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:34.674371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:34.695337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:34.696773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:34.699989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:34.701182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:35.035990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:35.058096 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a3545a24-f261-48af-a967-e38834c91172 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.410304 Jul 18 16:41:35.061398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 148/299] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:34 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:35.187940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6c5f0cb9-93fc-4d15-a108-d5952618fd4b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.451709 Jul 18 16:41:35.189974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 152/300] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:41:33 2022] POST /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments => generated 194 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:41:36.091845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:36.092864 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:36.109987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:36.112596 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:36.113777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:36.121438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:36.259457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:36.260542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:36.278306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:36.279502 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:36.281851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:36.283179 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:36.332551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:36.350155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-761285e7-7f6d-4494-be90-945780372377 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/ips" status: 200 len: 152 microversion: 2.20 time: 0.103925 Jul 18 16:41:36.351240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 153/301] 10.222.0.77 () {60 vars in 1288 bytes} [Mon Jul 18 16:41:36 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/ips => generated 152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:41:36.591372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:36.603690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-779b123a-4879-43de-9c66-1fd8083f47cd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.520242 Jul 18 16:41:36.607235 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 149/302] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:36 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:37.640581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:37.654381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:37.665346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.666456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.667995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:37.669048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:37.945508 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:37.953343 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-364464741", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07d4314d-9237-4c83-9875-1768cdeffac1"}], "security_groups": [{"name": "tempest-securitygroup--8860233"}], "key_name": "tempest-keypair-982414460", "user_data": "}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:37.972255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b49efc47-798a-4d34-a48a-32670435713f tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.336236 Jul 18 16:41:37.973778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 154/303] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:37 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:38.186108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] validate_networks() for [('07d4314d-9237-4c83-9875-1768cdeffac1', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:41:38.314659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-e4268963-6858-413e-a30b-a6a8032e386c req-6e394b8f-6572-4736-9d54-e448df54b50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02afaf37-c2d4-47bc-b4d1-dcd5d1539128", "name": "network-vif-plugged", "status": "completed", "tag": "7d2fb95f-9875-4fbf-a12a-413fd22ef8b7"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:38.330289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e4268963-6858-413e-a30b-a6a8032e386c req-6e394b8f-6572-4736-9d54-e448df54b50c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:38.331183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e4268963-6858-413e-a30b-a6a8032e386c req-6e394b8f-6572-4736-9d54-e448df54b50c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:38.356040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-e4268963-6858-413e-a30b-a6a8032e386c req-6e394b8f-6572-4736-9d54-e448df54b50c service nova] Creating event network-vif-plugged:7d2fb95f-9875-4fbf-a12a-413fd22ef8b7 for instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 on hv-cinder-83754 Jul 18 16:41:38.364821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-e4268963-6858-413e-a30b-a6a8032e386c req-6e394b8f-6572-4736-9d54-e448df54b50c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057695 Jul 18 16:41:38.366440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 155/304] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:38.809619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:38.818786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:38.842930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:38.844340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:38.845472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:38.845917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:38.877258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lazy-loading 'flavor' on Instance uuid 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:38.893896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:41:38.894728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:41:38.895719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:41:38.896854 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:41:38.898210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:41:38.924073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:38.924985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:38.926544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:38.928283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:38.972049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:41:38.988950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Getting quotas for user ab3be59ea4c74da3b4e19273102bccd9 and project afb65421f9504a918b7a47451fac6707. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:41:39.014161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:41:39.017290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:41:39.045313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:39.087546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9c60cbc8-0f14-43ab-8911-364dae45cb12 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.149356 Jul 18 16:41:39.088811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 150/305] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:41:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:41:39.096791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:39.097714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:39.105354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:39.106059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:39.107215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:39.107876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:39.396005 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:39.422399 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-04b4690f-3c16-4617-8330-da237723c62e tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1314 microversion: 2.1 time: 0.329581 Jul 18 16:41:39.424212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 151/306] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:39 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:39.434503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ab765577-a69c-4919-b1e5-6c86e2485022 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:39.436012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ab765577-a69c-4919-b1e5-6c86e2485022 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:39.560167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ab765577-a69c-4919-b1e5-6c86e2485022 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:39.568879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ab765577-a69c-4919-b1e5-6c86e2485022 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1244 microversion: 2.1 time: 0.142308 Jul 18 16:41:39.569404 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 152/307] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:39 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:39.600318 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7dd27cbb-2821-466c-848e-d5087cba1ed5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/action" status: 202 len: 0 microversion: 2.20 time: 0.797167 Jul 18 16:41:39.601750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 156/308] 10.222.0.77 () {62 vars in 1318 bytes} [Mon Jul 18 16:41:38 2022] POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:41:39.614803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:39.616931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:39.637681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:39.640081 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:39.642687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:39.644978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:40.028072 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:40.060594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:40.064151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:40.067139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-aa960b88-b4aa-4a99-9413-002f1d689653 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.459076 Jul 18 16:41:40.080093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 153/309] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:39 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:40.456624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:40.457520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:40.470754 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:40.472384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:40.473482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:40.473950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:40.601147 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:40.602375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:40.618489 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:40.619838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:40.622298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:40.623418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:40.642776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:40.702235 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:40.716739 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:40.717906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-60af8c3e-98b9-45d5-96d3-250078df59b9 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1498 microversion: 2.1 time: 0.271587 Jul 18 16:41:40.719270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 157/310] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:40 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:40.728585 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-499f1dac-2c43-42e6-961f-309d0d0bfa8c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1248 microversion: 2.1 time: 0.135402 Jul 18 16:41:40.729178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 154/311] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:40 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:41.104819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:41.105518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:41.114060 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:41.114668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:41.115525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:41.115961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:41.318608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:41.338053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:41.340671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:41.342513 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-53046351-dfc0-448f-94a7-1e6fd016b583 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.242141 Jul 18 16:41:41.343400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 158/312] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:41 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:41.756087 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:41.756811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:41.763510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:41.763959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:41.764738 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:41.765368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:41.843843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:41.854632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-707c04e8-529d-4c49-b650-591678dc73a9 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1248 microversion: 2.1 time: 0.101876 Jul 18 16:41:41.856051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 155/313] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:41 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:42.364238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:42.365314 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:42.372244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:42.372738 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:42.373800 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:42.374234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:42.564942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:42.580621 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:42.583679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:42.586372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-edbb1344-9ead-4986-8786-71f1deb17cc9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.226461 Jul 18 16:41:42.587960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 159/314] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:42 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:42.876928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:42.877915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:42.888085 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:42.888827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:42.890210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:42.890928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:42.992857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:43.002450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b6e45dc0-8e91-41b8-b3c7-4eb84fac1de3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1248 microversion: 2.1 time: 0.132633 Jul 18 16:41:43.003366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 156/315] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:42 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1248 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:43.614371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:43.615061 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:43.624995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:43.625681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:43.627541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:43.628042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:43.835656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:43.866204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:43.866204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:43.867828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7133d47a-dea6-4620-8290-6a00b9b83392 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.257554 Jul 18 16:41:43.874992 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 160/316] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:43 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:44.022084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:44.023904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:44.035140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.036281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.037893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.038920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.193093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:44.207418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1334fc6f-8101-4c56-8942-b3dee6e9cf07 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1240 microversion: 2.1 time: 0.190897 Jul 18 16:41:44.218014 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 157/317] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:44 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1240 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:44.444569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:44.445258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:44.458899 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.459400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.460223 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.460673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.494464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:41:44.635668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-31a296d8-e293-4950-aeb8-16d32e24f2db tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "DELETE /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 204 len: 0 microversion: 2.1 time: 0.199238 Jul 18 16:41:44.636488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 161/318] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:41:44 2022] DELETE /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:41:44.647521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:44.648093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:44.655354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.655809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.656591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.657104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.853299 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:44.867400 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-37b3d19d-cc93-4d70-87b2-6363a0ca4113 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1504 microversion: 2.1 time: 0.223991 Jul 18 16:41:44.868204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 158/319] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:44 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:44.905324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:44.906972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:44.912346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:44.919350 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.923084 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:44.925064 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:44.926058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:45.106741 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:45.115665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:45.117156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:45.118348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1e77d9d4-ab2a-496f-a172-411e12360a81 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.224687 Jul 18 16:41:45.119176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 162/320] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:44 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:45.229966 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:45.230763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:45.238281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:45.239033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:45.240168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:45.240946 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:45.324882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:45.343459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3ca2cf45-6865-4c94-806b-d4ca9a683576 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1296 microversion: 2.1 time: 0.119775 Jul 18 16:41:45.348337 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 159/321] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:45 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:45.545175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c5b6e7f0-83fb-4d66-ad0f-4ed390dd1960 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: .version_select at 0x7fc3a27e65e0>, body: {"keypair": {"name": "tempest-keypair-2122693310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKtYEbVicta+VcaPR7qnJCWBlGS4VC8lv11fZ86UZs2d+GGjb5xMf9O46hDL891MQPSoBzJcuWjTsACanpWtyBQF2HjdvmKidy7y/+8quF5gIHVZwhNGw9j/PZlDYGl1Q=="}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:45.568546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-c5b6e7f0-83fb-4d66-ad0f-4ed390dd1960 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:41:45.573184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-c5b6e7f0-83fb-4d66-ad0f-4ed390dd1960 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:41:45.641128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c5b6e7f0-83fb-4d66-ad0f-4ed390dd1960 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101245 Jul 18 16:41:45.642666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 163/322] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:41:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:45.890102 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:45.893078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:45.900918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:45.901678 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:45.903089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:45.904527 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:46.139518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:46.140461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:46.151427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:46.152028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:46.152935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:46.153975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:46.162463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:46.176342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a3e087d8-e3c4-4a23-9c1d-d762f6a2d2b6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1504 microversion: 2.1 time: 0.292819 Jul 18 16:41:46.178483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 160/323] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:45 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:46.369806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:46.372792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:46.389255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:46.390292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:46.391997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:46.392889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:46.423344 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:46.442303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:46.448345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:46.451387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-961ad8cd-9e91-4c81-836f-bfd88d34a8a0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.317272 Jul 18 16:41:46.453283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 164/324] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:46 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:46.518771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:46.541715 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c1b334cc-763c-4af0-91be-184e68967397 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1296 microversion: 2.1 time: 0.179009 Jul 18 16:41:46.542825 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 161/325] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:46 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:47.201966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:47.202637 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:47.210447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.210906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.211692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.212120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.475034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:47.481952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:47.483307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:47.483860 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7c52b83c-85c5-4355-8d7e-95f3958d9609 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1504 microversion: 2.1 time: 0.285686 Jul 18 16:41:47.484450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 165/326] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:47 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:47.491885 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.492899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.493855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.494517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.567777 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:47.568820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:47.575648 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.576096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.577096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:47.577524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:47.661088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:47.670320 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-289270ed-a561-4ca9-847c-d8d78d44ca15 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1296 microversion: 2.1 time: 0.105930 Jul 18 16:41:47.671547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 166/327] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:47 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:47.696883 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:47.707374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:47.709226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:47.710464 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4143df89-d447-46f1-acb2-55526155ef6a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.236195 Jul 18 16:41:47.710998 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 162/328] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:47 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:47.723239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1708733098", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "509e7a9e-2f1a-47ea-a4fb-2e64a591cc67"}], "security_groups": [{"name": "tempest-securitygroup--2011746545"}], "key_name": "tempest-keypair-2122693310", "user_data": "}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:47.848461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] validate_networks() for [('509e7a9e-2f1a-47ea-a4fb-2e64a591cc67', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:41:48.308731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:41:48.309422 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:41:48.309624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:41:48.310045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:41:48.310488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:41:48.320217 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.320706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.321558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.322041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.343163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:41:48.348185 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:41:48.361235 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:41:48.364997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:41:48.416994 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3a2ffa7c-9de8-4819-9f17-65076d46eae0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.702674 Jul 18 16:41:48.417658 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 167/329] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:41:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:41:48.432499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b0ced664-6f76-4c97-8741-aa123a6c1f30 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:48.433127 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b0ced664-6f76-4c97-8741-aa123a6c1f30 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:48.502577 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:48.506147 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b0ced664-6f76-4c97-8741-aa123a6c1f30 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:48.510296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:48.513889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b0ced664-6f76-4c97-8741-aa123a6c1f30 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1242 microversion: 2.1 time: 0.085266 Jul 18 16:41:48.521697 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 163/330] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:48 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:48.524270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.525006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.526455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.527180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.697037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:48.698077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:48.709081 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.710144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.711576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.712467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.808662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:48.818055 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bdefc432-d69e-4eae-b1a8-968e95c572ec tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1296 microversion: 2.1 time: 0.127292 Jul 18 16:41:48.819271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 164/331] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:48 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:48.832134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:48.833049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:48.840826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.841387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.842546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:48.843082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:48.945603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:49.085357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:49.089976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:49.097020 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9c888fd8-7861-4ce9-bcd0-5dd1b8dec7bd tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1504 microversion: 2.1 time: 0.599259 Jul 18 16:41:49.097613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 168/332] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:48 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:49.135610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:49.145160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:49.146820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:49.148006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0a38ee08-64b3-4c5d-b49d-33380fab4b17 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.327532 Jul 18 16:41:49.148587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 165/333] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:48 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:49.539001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:49.540087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:49.565227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:49.568418 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:49.570813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:49.572148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:49.759191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:49.786632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-328e0ad9-40e0-4599-92d5-2d419b63e182 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1238 microversion: 2.1 time: 0.253381 Jul 18 16:41:49.788413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 169/334] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:49 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1238 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:49.847473 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:49.849315 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:49.864322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:49.865602 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:49.868172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:49.868172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.025303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.046813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7978d955-6b48-4f0e-971d-ba8ec768e165 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1302 microversion: 2.1 time: 0.208157 Jul 18 16:41:50.048115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 166/335] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:49 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:50.119821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:50.120962 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:50.159126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.159979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.161781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.162611 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.173129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:50.174835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:50.205650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.207870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.209671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.210775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.440365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.451155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.453153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.455281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c0869ce9-120b-4fb1-a7d6-02d3ae427e8e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.292284 Jul 18 16:41:50.456209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 167/336] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:50 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:50.526243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.536866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7e40e960-c7c1-4e06-8168-28e260a72679 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1504 microversion: 2.1 time: 0.425291 Jul 18 16:41:50.537683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 170/337] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:50 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:50.781598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-a0c82d84-ef59-4125-a1dd-28e59857bd87 req-cc5e618d-3cb0-4615-99dc-589abe701064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02afaf37-c2d4-47bc-b4d1-dcd5d1539128", "name": "network-vif-deleted", "tag": "7d2fb95f-9875-4fbf-a12a-413fd22ef8b7"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:50.790574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-a0c82d84-ef59-4125-a1dd-28e59857bd87 req-cc5e618d-3cb0-4615-99dc-589abe701064 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.791106 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-a0c82d84-ef59-4125-a1dd-28e59857bd87 req-cc5e618d-3cb0-4615-99dc-589abe701064 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.804704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-a0c82d84-ef59-4125-a1dd-28e59857bd87 req-cc5e618d-3cb0-4615-99dc-589abe701064 service nova] Creating event network-vif-deleted:7d2fb95f-9875-4fbf-a12a-413fd22ef8b7 for instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 on hv-cinder-83754 Jul 18 16:41:50.806074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:50.806742 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:50.810505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-a0c82d84-ef59-4125-a1dd-28e59857bd87 req-cc5e618d-3cb0-4615-99dc-589abe701064 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Jul 18 16:41:50.811322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 168/338] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:50.815437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.816187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.816978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:50.817413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:50.887447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:50.896417 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0c154af1-926b-47fb-ae08-abac7b338a07 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1294 microversion: 2.1 time: 0.094257 Jul 18 16:41:50.897386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 171/339] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:50 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:51.074202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:51.075020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:51.082180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.082718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.083605 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.084165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.163043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:51.171409 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5fd322a8-3973-411e-913b-7ebbb6977def tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1302 microversion: 2.1 time: 0.101769 Jul 18 16:41:51.172859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 169/340] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:51 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:51.481209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:51.482327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:51.493755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.494520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.495940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.496710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.555102 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:51.555777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:51.562654 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.563166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.563999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.564440 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.661859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:51.672707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c815c6db-9fe5-427f-b18b-f3e0ad8a58af tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1462 microversion: 2.1 time: 0.121675 Jul 18 16:41:51.673604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 170/341] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:51 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:51.688359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:51.704273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:51.707920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:51.710438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e3252d5d-e29f-429b-98d6-b6d839f940f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.236485 Jul 18 16:41:51.711168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 172/342] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:51 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:51.913956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:51.914623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:51.922125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.922578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:51.923376 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:51.923809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.010204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.020179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b0313495-5a56-4696-b729-b302ed4da5b0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1294 microversion: 2.1 time: 0.110184 Jul 18 16:41:52.020775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 171/343] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:51 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:52.190542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:52.191267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:52.198062 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.198546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.199329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.199836 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.275602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.283666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1a0eafc6-14e7-466b-a94b-2a6f305dabbc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1302 microversion: 2.1 time: 0.097519 Jul 18 16:41:52.284264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 173/344] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:52 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:52.692445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:52.693123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:52.699809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.700272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.701067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.701502 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.743313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:52.744635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:52.772713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.775230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.775587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.777684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:52.779070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:52.782551 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:52.793417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-01c8a18b-2e0b-4e49-9122-b27248d1f9b3 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1462 microversion: 2.1 time: 0.104774 Jul 18 16:41:52.797757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 172/345] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:52 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:52.949295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.958749 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.960560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:52.962028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-017f4dc9-d957-4125-b729-4856f8ab0ff5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.226978 Jul 18 16:41:52.962788 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 174/346] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:52 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:53.038213 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:53.038852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:53.045540 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.045997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.046823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.047261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.132471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:53.146671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-da0b280f-d6ff-4908-a798-eba21d5cf26e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1294 microversion: 2.1 time: 0.112246 Jul 18 16:41:53.147643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 173/347] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:53 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1294 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:53.306074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:53.307139 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:53.318864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.319663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.321138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.321926 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.417810 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:53.428926 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-11d9075a-eb5b-4a00-88c0-ea01a52fbb4b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1302 microversion: 2.1 time: 0.130661 Jul 18 16:41:53.430194 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 175/348] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:53 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:53.826372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:53.830260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:53.850168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.851195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.853505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.854555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.959673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:53.960633 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:53.961610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lazy-loading 'fault' on Instance uuid 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:53.998372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:54.001371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:54.016951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.017559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.018224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.019766 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.020628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.025789 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3ba4800-18fc-4c45-9743-b231b31431b8 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1304 microversion: 2.1 time: 0.208862 Jul 18 16:41:54.026387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 174/349] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:53 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:54.168801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:54.170403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:54.182499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.183382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.184851 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.185650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.303613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.322594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1cb079dd-aea3-4250-b495-a4e1735ae38f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1300 microversion: 2.1 time: 0.157271 Jul 18 16:41:54.323468 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 175/350] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:54 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:54.330837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.346386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.349218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.351789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2b4f5345-92fb-4a61-90ff-c0144b90ce06 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.368080 Jul 18 16:41:54.353149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 176/351] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:53 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:54.456545 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:54.457425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:54.465686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.466330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.474279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:54.474840 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:54.587630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:54.607914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9d41f014-f292-44d8-a62c-4635641b3b70 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1302 microversion: 2.1 time: 0.155644 Jul 18 16:41:54.625022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 176/352] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:54 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:55.049471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:55.051026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:55.064105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.065241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.066924 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.068120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.123948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.124656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.125797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lazy-loading 'fault' on Instance uuid 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:55.201641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.210697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4e5871f7-cb22-47c8-a0b7-a5d0223dba0a tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1304 microversion: 2.1 time: 0.170039 Jul 18 16:41:55.211287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 177/353] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:55 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:55.348621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:55.349511 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:55.355513 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.355965 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.356739 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.357182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.372943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:55.373856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:55.381950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.382401 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.383218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.383651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.444929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.453729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0e26f9eb-cea2-4ce1-b82a-047f00962c9e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1300 microversion: 2.1 time: 0.108927 Jul 18 16:41:55.454321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 177/354] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:55 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:55.559447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.569107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.570666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.571933 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ef3ee927-9d54-40e5-a1a2-814ee3b6b139 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.204207 Jul 18 16:41:55.572546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 178/355] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:55 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:55.635793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:55.636418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:55.644270 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.644719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.645565 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:55.645997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:55.817300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:55.830145 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ec4889df-4a49-4251-acd9-80e6a120c4d6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.197959 Jul 18 16:41:55.831065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 178/356] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:55 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:56.228026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:56.228650 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:56.236782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.237420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.238757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.239522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.278680 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.279195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.279689 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lazy-loading 'fault' on Instance uuid 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:56.328954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:56.338271 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ef164063-9a4f-4406-ac07-605c40fd0bfa tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1304 microversion: 2.1 time: 0.113728 Jul 18 16:41:56.339129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 179/357] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:56 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:56.473847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:56.474576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:56.480900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.481343 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.482112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.482583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.547917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:56.556044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6e417335-60af-4b7b-ac6c-37d162d44519 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1300 microversion: 2.1 time: 0.087557 Jul 18 16:41:56.556640 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 179/358] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:56 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:56.592000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:56.592888 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:56.600851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.601474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.602366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.603078 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.764424 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:56.774011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:56.775683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:56.776993 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-911900d7-f82f-4c0f-ba16-64eb9792bc59 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.189477 Jul 18 16:41:56.777629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 180/359] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:56 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:41:56.856406 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:56.857178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:56.863860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.864300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:56.865077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:56.865512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.021932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:57.030002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e0212036-8d2b-4c77-9032-3d0bd3666d71 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.177947 Jul 18 16:41:57.030639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 180/360] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:56 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:57.371231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:57.372631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:57.383294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.383980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.385055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.385770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.426708 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.427288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.428092 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lazy-loading 'fault' on Instance uuid 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:41:57.496567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e56d53506d49a68c864556486c94c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a907861f2aca4a4286e9a46cdae6c4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:57.506216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-eab444da-95cd-4737-888a-f41ee67731a2 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 200 len: 1304 microversion: 2.1 time: 0.142345 Jul 18 16:41:57.507430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 181/361] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:57 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:57.574262 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:57.575693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:57.587463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.596201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.597333 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.597953 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.745423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:57.764901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f59fc9e3-a2b5-435d-84a7-8c668b5a2eee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1300 microversion: 2.1 time: 0.194565 Jul 18 16:41:57.766817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 181/362] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:57 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:57.799825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:57.801071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:57.809449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.810167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:57.812333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:57.814858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.048331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:58.048942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:58.062122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.063132 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.064098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.064704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.328975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:58.332686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:58.342912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:58.352671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:58.362979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-459ac70e-cbc4-4636-a3e1-8010dcf4d2df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.569775 Jul 18 16:41:58.363642 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 182/363] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:57 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:41:58.510855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=14 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:58.525419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:58.525985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] [instance: 02afaf37-c2d4-47bc-b4d1-dcd5d1539128] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:58.528256 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=10 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:58.542918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:58.549405 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.549857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.550853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.551274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.564335 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-acea2b46-bde8-4404-a6df-e3a000cc52c4 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.518333 Jul 18 16:41:58.575883 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 182/364] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:58 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:41:58.588300 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] HTTP exception thrown: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Request method failure captured: Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 HTTP/1.1 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y0K6mwGRZdDreLdZRKgDDn2PkzIzr7W0rdgkNCjrcys9vkBotGYmdHloEe5SXJQ8yRVSx3iDX9OOviOFmWz1aHOV14f5v7DbOrQ0X106rA1qv_P0rXl03rH8dtha2r6x0QARvdepb5_RGLxi6HNFItNgzVtWPgtAxwVI0LZXSAdAQg Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: a907861f2aca4a4286e9a46cdae6c4d2 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:41:58.601280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_a907861f2aca4a4286e9a46cdae6c4d2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/a907861f2aca4a4286e9a46cdae6c4d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: a907861f2aca4a4286e9a46cdae6c4d2 Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesActionsTest-2097345895 Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesActionsTest-2097345895-project Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 33e56d53506d49a68c864556486c94c4 Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesActionsTest-2097345895-project Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. Jul 18 16:41:58.604071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '02afaf37-c2d4-47bc-b4d1-dcd5d1539128'} Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:41:58.605482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. Jul 18 16:41:58.608052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:41:58.614922 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] Returning 404 to user: Instance 02afaf37-c2d4-47bc-b4d1-dcd5d1539128 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:41:58.622921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6cc55e72-2b4e-4442-a581-8bcbb673b2e6 tempest-VolumesActionsTest-2097345895 tempest-VolumesActionsTest-2097345895-project] 10.222.0.77 "GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128" status: 404 len: 111 microversion: 2.1 time: 0.101125 Jul 18 16:41:58.631950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 183/365] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:58 2022] GET /compute/v2.1/servers/02afaf37-c2d4-47bc-b4d1-dcd5d1539128 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:41:58.798666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:58.800557 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:58.815056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.816149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:58.817886 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:58.819265 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:59.017338 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:41:59.040256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-da20ab2d-42ce-4be1-a119-50b65cf60253 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1300 microversion: 2.1 time: 0.250308 Jul 18 16:41:59.042160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 183/366] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:58 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:41:59.268294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-107dd790-6407-4ceb-b278-6c0e16a9b5bb req-bd15cf96-d373-437e-bde1-cf532a555928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:41:59.327301 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-107dd790-6407-4ceb-b278-6c0e16a9b5bb req-bd15cf96-d373-437e-bde1-cf532a555928 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:59.328441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-107dd790-6407-4ceb-b278-6c0e16a9b5bb req-bd15cf96-d373-437e-bde1-cf532a555928 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:59.405298 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-107dd790-6407-4ceb-b278-6c0e16a9b5bb req-bd15cf96-d373-437e-bde1-cf532a555928 service nova] Creating event network-changed:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:41:59.415691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:59.417865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:59.426176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-107dd790-6407-4ceb-b278-6c0e16a9b5bb req-bd15cf96-d373-437e-bde1-cf532a555928 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176526 Jul 18 16:41:59.429910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 184/367] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:41:59.436042 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:59.437927 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:59.441109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:59.463250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:59.597388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:41:59.599703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:41:59.642975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:59.644183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:41:59.645715 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:41:59.648447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:00.052667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:00.064162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:00.065857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:00.067095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-511fb423-1fef-490f-8d0f-a944243021df tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.668991 Jul 18 16:42:00.068224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 184/368] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:41:59 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:00.072705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:00.073311 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:00.079761 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:00.080215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:00.081653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:00.082273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:00.201075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:00.206553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:00.212472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0735e945-6970-41c6-b64a-9577f72a5550 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.624660 Jul 18 16:42:00.213483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 185/369] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:41:59 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:00.314708 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:00.326653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ac449699-172b-440c-90ca-1807e428a7f3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.257458 Jul 18 16:42:00.327598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 185/370] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:00 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:01.098657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:01.099752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:01.112274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.113671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.115525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.117151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.249649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:01.252717 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:01.266214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.267448 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.268714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.269598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.371457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:01.382818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:01.384608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:01.386577 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cd66fb6b-24dd-4f5d-b6e9-89ad147acbba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.293892 Jul 18 16:42:01.387880 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 186/371] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:01 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:01.398347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:01.399569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:01.409602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.410059 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.416469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.417297 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.496956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:01.526651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d62d21a5-4e18-4044-a7c1-c0262439df64 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.271305 Jul 18 16:42:01.526651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 186/372] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:01 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:01.526651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-68d2ce7d-c717-4dbe-81b1-00b35494e8d7 req-9adcb8a6-3767-41d5-b9da-b924c6870e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b744aaad-a923-464c-8879-90ccec466724", "tag": "ca139efe-c37e-4064-a928-8621794e3268"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:01.540895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-68d2ce7d-c717-4dbe-81b1-00b35494e8d7 req-9adcb8a6-3767-41d5-b9da-b924c6870e76 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:01.541663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-68d2ce7d-c717-4dbe-81b1-00b35494e8d7 req-9adcb8a6-3767-41d5-b9da-b924c6870e76 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:01.565594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-68d2ce7d-c717-4dbe-81b1-00b35494e8d7 req-9adcb8a6-3767-41d5-b9da-b924c6870e76 service nova] Creating event network-changed:ca139efe-c37e-4064-a928-8621794e3268 for instance b744aaad-a923-464c-8879-90ccec466724 on hv-cinder-83754 Jul 18 16:42:01.575282 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-68d2ce7d-c717-4dbe-81b1-00b35494e8d7 req-9adcb8a6-3767-41d5-b9da-b924c6870e76 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058792 Jul 18 16:42:01.576373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 187/373] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:01.629655 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:01.637453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e23b401f-7bd6-4632-8185-3f463bf4eea1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.247992 Jul 18 16:42:01.638025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 187/374] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:01 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:02.415198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:02.415920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:02.422868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.423315 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.424095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.424526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.530520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:02.531176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:02.539823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.540296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.541247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.541551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.602841 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:02.617807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:02.620314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:02.621755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ddd190ef-c558-447a-89dd-c77daa51d4ce tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.210916 Jul 18 16:42:02.622821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 188/375] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:02 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:02.659597 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:02.660705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:02.670705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.671493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.673029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:02.673813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:02.732747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:02.745323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f987942e-2ce3-4ede-b634-21eb072463e3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.218559 Jul 18 16:42:02.746561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 188/376] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:02 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:02.844704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:02.847466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:02.855294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cf8ac714-c992-401a-a4f9-7ca09107cab9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.202744 Jul 18 16:42:02.856203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 189/377] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:02 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:03.644904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:03.659631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:03.672535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:03.673599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:03.674935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:03.675874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:03.767879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:03.769154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:03.775673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:03.776706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:03.777705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:03.778295 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:03.985600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:03.994964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:03.996908 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:03.998465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6f099e50-fab5-49f8-94a6-7ff06e7d0f3c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.359843 Jul 18 16:42:03.999044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 189/378] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:03 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:04.004586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:04.005469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:04.012710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:04.013334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:04.013970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:04.014481 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:04.052471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:04.065936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b081072a-c5d1-4474-a450-9afcede9cd39 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.303432 Jul 18 16:42:04.066982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 190/379] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:03 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:04.195730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:04.204608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-50158e9e-9901-48d9-90d6-a17711f19065 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.204396 Jul 18 16:42:04.205245 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 190/380] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:03 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:05.027246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:05.028988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:05.040076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.040748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.042084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.042940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.086222 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:05.087188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:05.105239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.106118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.107653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.108525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.268757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:05.285043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:05.288497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:05.290573 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fe72b8bf-e570-4dac-8383-af74de4c1b23 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.268903 Jul 18 16:42:05.291566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 191/381] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:05 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:05.301681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:05.303413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:05.317412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:05.317677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.318489 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.319858 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:05.320627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:05.332489 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c32fb70a-6f03-455c-9783-279c2d8a3210 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.250334 Jul 18 16:42:05.333938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 191/382] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:05 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:05.512159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:05.520746 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-66156a8e-7a54-484f-8b4f-5e599e89fc4c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.226501 Jul 18 16:42:05.521320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 192/383] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:05 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:06.319357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:06.319901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:06.327685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.328161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.328935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.329407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.355988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:06.356625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:06.363966 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.364417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.365189 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.365626 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.492455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:06.508265 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:06.510915 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:06.512676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6938f700-882c-467d-aa85-200d3fd8ffb6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.197254 Jul 18 16:42:06.513469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 192/384] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:06 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:06.522617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:06.535477 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ad1e2b48-4716-4138-bbe4-18f278f5f43a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.183248 Jul 18 16:42:06.536763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 193/385] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:06 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:06.542566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:06.543795 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:06.555120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.555653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.556569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:06.557068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:06.771930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:06.781711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-729662a9-0a54-41e0-b989-3a9bf5b6aa63 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.245401 Jul 18 16:42:06.782296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 193/386] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:06 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:07.540288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:07.540958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:07.547750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.548190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.548972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.549471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.563223 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:07.563936 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:07.573916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.574361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.575188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.575969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.719175 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:07.728192 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:07.729698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:07.730935 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-40c58ae3-46e7-4719-88a4-ee556543c846 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.194668 Jul 18 16:42:07.731483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 194/387] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:07 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:07.741747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:07.755685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8455668e-453a-4691-aefd-29ade61a7f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.197988 Jul 18 16:42:07.756508 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 194/388] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:07 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:07.810153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:07.810711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:07.817456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.817899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.818727 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:07.819159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:07.980955 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:07.988938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-25d552bf-89ea-4072-a369-bfce8bf7ca7b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.182850 Jul 18 16:42:07.989524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 195/389] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:07 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:08.753809 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:08.755946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:08.772545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:08.773616 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:08.774466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:08.775341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:08.775984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:08.776101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:08.783849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:08.784688 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:08.785809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:08.786501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:09.058495 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:09.081868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:09.085984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:09.090142 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9c1175ce-3ab2-4555-8152-ed3b6118c6e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.343070 Jul 18 16:42:09.091105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 195/390] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:08 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:09.101930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:09.103979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:09.111270 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:09.114850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:09.118008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:09.119309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:09.121364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:09.121619 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-afbfba53-49a3-4e44-b25d-ad985a9de582 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.350903 Jul 18 16:42:09.122778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:09.123726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 196/391] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:08 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:09.358697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:09.367402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cc63ec3d-040c-4091-8692-b8131e1345df tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.274457 Jul 18 16:42:09.367995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 196/392] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:09 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:10.115512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:10.116818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:10.163327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:10.166274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:10.180521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:10.189686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.191330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:10.193675 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.196725 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:10.238009 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.244597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:10.254373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.257594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:10.526274 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:10.582791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:10.596870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:10.613260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0c0e59c9-b3a1-4079-a027-2a5252b14853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.501396 Jul 18 16:42:10.644569 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 197/393] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:10 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:10.700315 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:10.708133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:10.742112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:10.754390 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a8825d3e-9ae1-4f60-8d69-32ffd708fd17 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.608864 Jul 18 16:42:10.755016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 197/394] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:10 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:10.768239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.771892 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:10.773410 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:10.774156 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:11.084091 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-64b23f26-740a-4199-b59c-ef97843a3294 req-cdd8cb3f-3b8e-4885-98b7-fe2acc75ddaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "name": "network-vif-plugged", "status": "completed", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:11.109595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-64b23f26-740a-4199-b59c-ef97843a3294 req-cdd8cb3f-3b8e-4885-98b7-fe2acc75ddaa service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:11.110071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-64b23f26-740a-4199-b59c-ef97843a3294 req-cdd8cb3f-3b8e-4885-98b7-fe2acc75ddaa service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:11.138905 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:11.148509 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3a57e29-0bc0-4eb4-9ec6-7152ec4540b5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.486762 Jul 18 16:42:11.151043 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-64b23f26-740a-4199-b59c-ef97843a3294 req-cdd8cb3f-3b8e-4885-98b7-fe2acc75ddaa service nova] Creating event network-vif-plugged:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:42:11.152073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 198/395] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:10 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:11.168966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-64b23f26-740a-4199-b59c-ef97843a3294 req-cdd8cb3f-3b8e-4885-98b7-fe2acc75ddaa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089800 Jul 18 16:42:11.177747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 198/396] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:11.650010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:11.650670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:11.660638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:11.665285 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:11.667890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:11.671491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:11.775755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:11.777070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:11.786896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:11.788381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:11.789910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:11.791319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:12.003206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:12.012409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8180c7c1-55a9-48c1-91bc-184f1cebaa2b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.242606 Jul 18 16:42:12.023824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 199/397] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:11 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:12.170211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:12.173083 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:12.193087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:12.194997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:12.195968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:12.196909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:12.242047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:12.279028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:12.289032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:12.299822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-65fde0c2-de6c-4258-b6d1-bb369607b5bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1745 microversion: 2.20 time: 0.654398 Jul 18 16:42:12.300782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 199/398] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:11 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1745 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:12.676711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:12.714991 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8d1ce08a-3dc1-4ede-8d88-5759ad6f4c93 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.541356 Jul 18 16:42:12.716589 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 200/399] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:12 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:13.030920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:13.031742 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:13.040497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.043597 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.045832 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.047664 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.289546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:13.317767 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e52afd85-fca9-431e-9888-145217f6e14a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.290625 Jul 18 16:42:13.322329 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 200/400] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:13 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:13.331562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:13.332854 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:13.344592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.347383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.351288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.352762 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.733263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:13.734280 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:13.740613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:13.768256 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:13.770656 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.777760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.780446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:13.783476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:13.785871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:13.789010 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4b4577fa-6436-4371-b7d7-5af7207f2a87 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.461147 Jul 18 16:42:13.816593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 201/401] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:13 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:14.307672 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:14.337786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-31f2572d-ce53-406d-bf36-55a6dd387ba7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.608349 Jul 18 16:42:14.340397 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:14.341526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:14.344933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 201/402] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:13 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:14.364819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:14.365688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:14.367161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:14.367938 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:14.833211 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:14.833970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:14.846518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:14.848732 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:14.850371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:14.850849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:15.025417 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:15.092086 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3a30debf-d2df-476e-bb38-4b0a3963a2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.747692 Jul 18 16:42:15.093779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 202/403] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:14 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:15.112482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a22a6798-8125-4fd0-ae29-5ce87ac6e1dd req-081b95cf-5435-47e9-98cd-6c2e1d5b2a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "name": "network-vif-plugged", "status": "completed", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:15.145105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a22a6798-8125-4fd0-ae29-5ce87ac6e1dd req-081b95cf-5435-47e9-98cd-6c2e1d5b2a23 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:15.147362 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a22a6798-8125-4fd0-ae29-5ce87ac6e1dd req-081b95cf-5435-47e9-98cd-6c2e1d5b2a23 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:15.156711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:15.179434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a22a6798-8125-4fd0-ae29-5ce87ac6e1dd req-081b95cf-5435-47e9-98cd-6c2e1d5b2a23 service nova] Creating event network-vif-plugged:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:42:15.193805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-a22a6798-8125-4fd0-ae29-5ce87ac6e1dd req-081b95cf-5435-47e9-98cd-6c2e1d5b2a23 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085366 Jul 18 16:42:15.196991 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 203/404] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:42:15.238936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:15.255100 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:15.258002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:15.259553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f1466f14-f498-4216-8bf3-58a0c42e81a6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.431119 Jul 18 16:42:15.262284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 202/405] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:14 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:15.363887 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:15.365942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:15.390830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:15.392022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:15.393614 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:15.394286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:15.592602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:15.605338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e2e2bc9b-03a9-4a0b-b3ce-66af0f911f03 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.246699 Jul 18 16:42:15.607056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 204/406] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:15 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:16.125778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:16.129520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:16.153877 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.156488 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:16.161789 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.162960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:16.299394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:16.301769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:16.323601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.324726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:16.331293 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.332544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:16.817410 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:16.833723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-83c8633d-dcfc-42ac-ac99-fcb21a6778b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.716471 Jul 18 16:42:16.834558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 203/407] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:16 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:16.839971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:16.840643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:16.849394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.850013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:16.851063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:16.851781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:17.305141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:17.321598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-93a2cb3a-ab30-496f-b512-d9336e46dd23 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.485822 Jul 18 16:42:17.322364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 204/408] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:16 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:17.385409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:17.402595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:17.410696 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:17.423400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b9861dd5-9bb8-44a3-9f9e-ca7c4df01d1c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 1.134332 Jul 18 16:42:17.426672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 205/409] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:16 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:17.858928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:17.860834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:17.877313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:17.879304 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:17.880920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:17.902822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:18.356983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:18.358230 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:18.380150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:18.386054 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:18.393536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:18.397184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:18.528033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:18.539494 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d690bf95-12a1-42c9-ada4-e26bb5af4f37 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 0.689021 Jul 18 16:42:18.543503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 205/410] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:17 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:18.558214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:18.561104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:18.575061 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:18.576227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:18.578473 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:18.579559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:18.695414 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:19.184970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:19.220732 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:19.243148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:19.254024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1350267a-8468-4035-9684-d6cba420e587 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.708471 Jul 18 16:42:19.256914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 206/411] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:18 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:19.427170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:19.456130 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0810faf9-f673-4044-b8e7-5e686bdc8587 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 1.106576 Jul 18 16:42:19.471909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 206/412] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:18 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:19.573418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:19.574569 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:19.609066 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:19.612220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:19.635603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:19.636576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:20.286952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:20.292392 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:20.332428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:20.333374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:20.348529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:20.348529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:20.953279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:20.964036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0d47f60a-bd2e-46fb-bdb8-5d6f78447e65 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1367 microversion: 2.1 time: 1.396101 Jul 18 16:42:20.985855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 207/413] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:19 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1367 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:20.993578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:20.998447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:21.011577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:21.015953 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:21.017430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:21.023216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:21.329221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:21.371388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:21.374999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:21.384840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1402e9df-4f66-4502-861a-782c5da9aebd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 1.107748 Jul 18 16:42:21.406844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 207/414] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:20 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:21.420050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-4d02aece-60dc-4b63-baad-0168b8411eef req-fbd960ba-e49a-45e7-a962-dc41c0e81634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b744aaad-a923-464c-8879-90ccec466724", "name": "network-vif-plugged", "status": "completed", "tag": "ca139efe-c37e-4064-a928-8621794e3268"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:21.491510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-4d02aece-60dc-4b63-baad-0168b8411eef req-fbd960ba-e49a-45e7-a962-dc41c0e81634 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:21.500604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-4d02aece-60dc-4b63-baad-0168b8411eef req-fbd960ba-e49a-45e7-a962-dc41c0e81634 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:21.557056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-4d02aece-60dc-4b63-baad-0168b8411eef req-fbd960ba-e49a-45e7-a962-dc41c0e81634 service nova] Creating event network-vif-plugged:ca139efe-c37e-4064-a928-8621794e3268 for instance b744aaad-a923-464c-8879-90ccec466724 on hv-cinder-83754 Jul 18 16:42:21.578157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-4d02aece-60dc-4b63-baad-0168b8411eef req-fbd960ba-e49a-45e7-a962-dc41c0e81634 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161508 Jul 18 16:42:21.589130 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 208/415] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:21.748007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:21.758258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dcffc21b-651f-4274-bc69-9dfb22e50ad1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 0.770170 Jul 18 16:42:21.768662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 208/416] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:20 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:21.994346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:21.995522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:22.018989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:22.020291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:22.021351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:22.022750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:22.425693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:22.426321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:22.443050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:22.444423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:22.450105 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:22.451652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:23.005595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:23.022191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-baf099ad-b7d6-4b8c-b44a-6d1caebe1f32 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1561 microversion: 2.1 time: 1.032160 Jul 18 16:42:23.027217 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 209/417] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:21 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1561 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:23.097864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:23.103046 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:23.151205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:23.156402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:23.168322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:23.169332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:23.175827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:23.176566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:23.178945 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:23.183325 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4688ed0d-d75e-40b3-af1d-4ffdd01ec036 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.760034 Jul 18 16:42:23.188571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 209/418] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:22 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:23.209498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:23.210392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:23.229306 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:23.232559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:23.241060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:23.243196 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:23.622351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7a242dc8-161f-4700-bae8-f5468cdf3b5c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.431982 Jul 18 16:42:23.623514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 210/419] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:42:23 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-interface => generated 284 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:24.213778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:24.215923 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:24.275879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:24.276336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:24.277144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:24.277571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:24.683828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:24.735056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-62cbaacd-a78f-49d4-ac3f-d1997627431f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1368 microversion: 2.1 time: 1.678655 Jul 18 16:42:24.738541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 210/420] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:23 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1368 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:24.763202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:24.801214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:24.816023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:24.818308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f68e1a39-1a4c-4d58-b675-e59eeb6f6601 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.616520 Jul 18 16:42:24.834201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 211/421] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:24 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:25.770144 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:25.772509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:25.826281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:25.829747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:25.835538 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:25.839134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:25.885810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:25.887988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:25.930274 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:25.931152 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:25.932621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:25.955745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:26.797779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:26.817374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:26.826723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:26.829520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b00fe6b2-fc01-42ae-969d-15e0b2d0ed35 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.958541 Jul 18 16:42:26.830756 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 212/422] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:25 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:27.875633 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:27.879366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:27.913461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:27.914107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:27.924599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:27.927610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:28.479508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:28.494459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:28.494459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:28.522561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e633f250-bf7e-4c49-9dba-229d2297d9de tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.634407 Jul 18 16:42:28.523529 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 213/423] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:27 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:28.573072 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:28.601183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8435f075-8398-486c-bf43-6a6e0b7701b1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1558 microversion: 2.1 time: 2.836072 Jul 18 16:42:28.606591 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 211/424] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:42:25 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1558 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:28.650634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:28.654369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:28.708571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:28.709322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:28.728307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:28.729377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:29.544712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-227f5bdf-5c40-4b75-af84-a835688b08de tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.901663 Jul 18 16:42:29.547706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 214/425] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:42:28 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/os-interface => generated 284 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:29.560936 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:29.562018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:29.631494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:29.635469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:29.645508 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:29.647243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:30.582322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:30.655484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:30.657324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:30.658688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9eafbc9c-c5e9-4598-aecc-6facbd38a9f2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 1.105678 Jul 18 16:42:30.680843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 212/426] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:29 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:31.718166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:31.718988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:31.736932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:31.737404 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:31.742578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:31.743584 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:32.606308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:32.620005 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:32.621259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:32.631612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e65741b1-f886-4ddf-ab99-97c984af9862 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.917872 Jul 18 16:42:32.644895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 215/427] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:31 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:32.757735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-7b8a0b5d-b720-46ce-889c-59db03f7d1eb req-5914cd08-3bc8-4292-888e-3590316bb6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:32.777811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-7b8a0b5d-b720-46ce-889c-59db03f7d1eb req-5914cd08-3bc8-4292-888e-3590316bb6d6 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:32.778259 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-7b8a0b5d-b720-46ce-889c-59db03f7d1eb req-5914cd08-3bc8-4292-888e-3590316bb6d6 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:32.823988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-7b8a0b5d-b720-46ce-889c-59db03f7d1eb req-5914cd08-3bc8-4292-888e-3590316bb6d6 service nova] Creating event network-changed:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:42:32.838306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-7b8a0b5d-b720-46ce-889c-59db03f7d1eb req-5914cd08-3bc8-4292-888e-3590316bb6d6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084455 Jul 18 16:42:32.847676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 213/428] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:42:33.655645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:33.656483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:33.686658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:33.689896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:33.696279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:33.696894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:34.958180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:35.001111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:35.013366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:35.020060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6e55d9ac-16e8-498d-a577-a73ac1a3b292 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 1.367979 Jul 18 16:42:35.034542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 216/429] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:33 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:35.399428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-e51eb3b1-0e40-4f6f-8c2b-d7c5f6cf198c req-f2608f8b-4192-4f3f-8549-68380a4f29e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b744aaad-a923-464c-8879-90ccec466724", "tag": "ca139efe-c37e-4064-a928-8621794e3268"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:35.482074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e51eb3b1-0e40-4f6f-8c2b-d7c5f6cf198c req-f2608f8b-4192-4f3f-8549-68380a4f29e9 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:35.483534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e51eb3b1-0e40-4f6f-8c2b-d7c5f6cf198c req-f2608f8b-4192-4f3f-8549-68380a4f29e9 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:35.552178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-e51eb3b1-0e40-4f6f-8c2b-d7c5f6cf198c req-f2608f8b-4192-4f3f-8549-68380a4f29e9 service nova] Creating event network-changed:ca139efe-c37e-4064-a928-8621794e3268 for instance b744aaad-a923-464c-8879-90ccec466724 on hv-cinder-83754 Jul 18 16:42:35.570951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-e51eb3b1-0e40-4f6f-8c2b-d7c5f6cf198c req-f2608f8b-4192-4f3f-8549-68380a4f29e9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181888 Jul 18 16:42:35.577420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 214/430] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:36.046149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:36.047716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:36.069903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:36.071311 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:36.072124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:36.082001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:37.835951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:37.876632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:37.879586 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:37.881368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3bf3587e-4ab6-4136-89b4-ef4d0e0707b0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 1.839627 Jul 18 16:42:37.882730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 217/431] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:36 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:38.906227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:38.918534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:38.959796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:38.961206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:38.971605 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:38.972615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:39.662786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:39.685813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:39.693056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:39.695565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-de181f43-ca8d-4883-9731-14e41140e873 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.797467 Jul 18 16:42:39.753216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 215/432] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:38 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:40.760490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:40.761835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:40.776298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=42 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:40.787637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:40.788478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:40.802276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:40.803254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:41.338907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:41.354670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:41.361838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:41.367451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-56a81dbc-bfc6-4756-ba17-859ec1188525 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.611209 Jul 18 16:42:41.369002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 218/433] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:40 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:42.410078 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:42.412640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:42.421909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=40 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:42.467984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:42.471969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:42.483032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:42.484551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:42.916469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:42.930562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:42.933550 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:42.943083 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7507570a-5da0-42a4-97f9-94afddc11280 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1740 microversion: 2.20 time: 0.549613 Jul 18 16:42:42.943738 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 216/434] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:42 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1740 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:43.971336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:43.973491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:43.984190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:43.985993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:43.987843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:43.988478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:45.084218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:45.205864 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:45.229484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:45.245970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1871e0b6-8e7f-4512-8d93-3d25db7ac981 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1722 microversion: 2.20 time: 1.276243 Jul 18 16:42:45.259349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 219/435] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:43 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1722 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:46.273539 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:46.274524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:46.290057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:46.297064 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:46.300890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:46.303216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:46.324898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=67 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:47.042628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-7cd8b22d-6d28-4d65-b3c6-b807b52808d5 req-e8a03dc2-219d-4734-89ac-8e49b8fc15fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "name": "network-vif-unplugged", "status": "completed", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:47.069036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7cd8b22d-6d28-4d65-b3c6-b807b52808d5 req-e8a03dc2-219d-4734-89ac-8e49b8fc15fd service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:47.074391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7cd8b22d-6d28-4d65-b3c6-b807b52808d5 req-e8a03dc2-219d-4734-89ac-8e49b8fc15fd service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:47.162541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-7cd8b22d-6d28-4d65-b3c6-b807b52808d5 req-e8a03dc2-219d-4734-89ac-8e49b8fc15fd service nova] Creating event network-vif-unplugged:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:42:47.182114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-7cd8b22d-6d28-4d65-b3c6-b807b52808d5 req-e8a03dc2-219d-4734-89ac-8e49b8fc15fd service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141212 Jul 18 16:42:47.186608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 220/436] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:47.335732 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:47.346495 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:47.352364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:47.353677 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5c37f8bc-18fe-44f5-84f3-c40ce96f7998 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1722 microversion: 2.20 time: 1.084221 Jul 18 16:42:47.354274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 217/437] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:46 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1722 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:48.392141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:48.394373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:48.412215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:48.412926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:48.413976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:48.416822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:48.719167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:48.727788 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=84 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:48.735758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:48.740300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:48.741783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1fe37cf2-233b-46f5-9849-33d7e1b99e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1725 microversion: 2.20 time: 0.356316 Jul 18 16:42:48.742510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 221/438] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:48 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:48.770448 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa32b647-90cd-46ce-9040-2320018a9255"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:48.772659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:48.796255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:48.796758 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:48.797984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:48.798779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:49.634773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e7300cf7-27a5-4e36-8535-16ea2fc6e2e9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.868314 Jul 18 16:42:49.635653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 218/439] 10.222.0.77 () {62 vars in 1363 bytes} [Mon Jul 18 16:42:48 2022] POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 188 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:49.913445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:49.914939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:49.923380 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:49.924229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:49.925268 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:49.926189 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:50.300412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-25c98dd9-164e-4b28-9c5c-70d29c0c1b86 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/action" status: 202 len: 0 microversion: 2.20 time: 0.392068 Jul 18 16:42:50.308681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 222/440] 10.222.0.77 () {62 vars in 1318 bytes} [Mon Jul 18 16:42:49 2022] POST /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:42:50.310562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:50.311367 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:50.330974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:50.332262 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:50.333290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:50.333832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:50.911382 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:50.924541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:50.928369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:50.929568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7482a068-0a39-479d-ab94-ec4e8cb9e373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1751 microversion: 2.20 time: 0.623955 Jul 18 16:42:50.935783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 219/441] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:50 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1751 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:51.958903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:51.960977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:52.002394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:52.005902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:52.009907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:52.025887 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:52.373815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:52.386648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:52.391253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:52.395979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0f086912-beea-418a-8108-d2af460f6b07 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1751 microversion: 2.20 time: 0.442887 Jul 18 16:42:52.396716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 223/442] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:51 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:53.416263 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:53.417628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:53.434944 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:53.436310 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:53.437326 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:53.448041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:53.892223 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:53.902173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:53.931892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:53.933429 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-879ead1e-ef55-4f03-9caf-5732f13dc7b2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1751 microversion: 2.20 time: 0.521314 Jul 18 16:42:53.934481 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 220/443] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:53 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1751 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:54.212258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-60a8a999-f064-498a-9eb9-27322f033dc3 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Action: 'create', calling method: .version_select at 0x7fc3a207bee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1011843527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj7oNX6sY6qOvASjFU5GjnzXSdfWxTumJU83a7rrS78PeeXlzZR42DH4OlxqNhJPYNqKSID7dmhxi91Kfv+OhpnfTIQd+V03ngtdSmDgsPndjH1J7+PxRK9esOPvO54cQ=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:54.239317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-60a8a999-f064-498a-9eb9-27322f033dc3 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for project edffd84b958d4e2a880fae7c4709d36d. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:42:54.245347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-60a8a999-f064-498a-9eb9-27322f033dc3 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for user 6c7e0694c5ab46a4adef7a1f7b1fed4c and project edffd84b958d4e2a880fae7c4709d36d. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:42:54.276600 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-60a8a999-f064-498a-9eb9-27322f033dc3 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.334396 Jul 18 16:42:54.278556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 224/444] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:42:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:54.955127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:54.956474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:54.968556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:54.969008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:54.969803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:54.970239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:55.357031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:55.372769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:55.375237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:55.376985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6b74980e-4239-4b28-b283-5f46b1e0c2f5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1753 microversion: 2.20 time: 0.426131 Jul 18 16:42:55.389623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 221/445] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:54 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1753 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:42:56.397452 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:56.398082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:56.410941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:56.411401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:56.412469 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:56.412636 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:56.902455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:56.922466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:56.928828 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:56.932781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8ed7fa42-73d9-4c37-ba2a-f9476ecde6fb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.538984 Jul 18 16:42:56.935791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 225/446] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:56 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:57.975166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:57.975838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:58.001449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:58.002250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:58.004625 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:58.005453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:58.621798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:58.647880 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:58.650401 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:42:58.652430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fb910942-fc5d-45ad-8025-29efab4c6af0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.697871 Jul 18 16:42:58.664492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 222/447] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:57 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:59.672947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:59.679815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:42:59.709762 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:59.710510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:42:59.711649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:42:59.712358 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:00.139447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:00.158504 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:00.161275 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:00.167958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e6573d43-691c-4ed4-b2dc-e3f8581712c2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.499709 Jul 18 16:43:00.170056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 226/448] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:42:59 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:43:01.201105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:01.206802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:01.220961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:01.221411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:01.226878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:01.227322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:01.723817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:01.776403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:01.782824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:01.793609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e366d3bd-caf7-46d9-a142-2cb1b4d69693 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.605775 Jul 18 16:43:01.796206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 223/449] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:01 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:02.814393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:02.815197 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:02.826231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:02.829139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:02.833131 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:02.833907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:03.145812 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:03.158634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:03.163360 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:03.166865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c95a5206-e75b-4708-8038-b5a3b2405077 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.357392 Jul 18 16:43:03.169144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 227/450] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:02 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:04.213647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:04.215044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:04.265024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:04.265811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:04.266893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:04.267796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:04.651977 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:04.673921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:04.679907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:04.684072 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c7353beb-fea2-431c-b913-aac85782afed tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.478899 Jul 18 16:43:04.707303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 224/451] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:04 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:05.713912 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:05.714699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:05.717347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:05.723689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:05.724144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:05.725012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:05.725464 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:05.921117 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:05.931558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:05.934915 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:05.937259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d31ad164-d1f1-41ab-8879-b127efba2e1e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.227696 Jul 18 16:43:05.938519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 228/452] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:05 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:06.969949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:06.972836 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:06.986183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:06.987015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:06.988217 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:06.989394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:07.191797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:07.199613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ac62ce-7db1-4370-a328-40d73f459f96"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:07.201916 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:07.210882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:07.212526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:07.213792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2e6ea78d-de9a-4c3f-869e-65c381e10b1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.258612 Jul 18 16:43:07.214372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 225/453] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:06 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:07.237539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:07.238573 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:07.239818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:07.240736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:08.239007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:08.240946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:08.266192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:08.267199 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:08.268996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:08.270081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:08.572732 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:08.596207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:08.600058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:08.602939 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-92a22206-5a4c-47ac-a948-f29859fb8e7d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.371150 Jul 18 16:43:08.616483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 226/454] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:08 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:09.648925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:09.651153 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:09.661187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:09.661653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:09.662455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:09.663085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:09.828239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:09.839155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:09.841229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:09.842502 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-07e93bdc-f827-46b8-ac40-2493d5e46753 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.202865 Jul 18 16:43:09.843081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 227/455] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:09 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:10.861858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:10.862526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:10.869141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:10.869593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:10.870371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:10.870840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:11.035747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:11.045707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:11.047481 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:11.049461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-881712c3-87c2-46f0-b9f7-ab33086e8356 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.191126 Jul 18 16:43:11.061604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 228/456] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:10 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:43:11.062336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-83f6894c-328d-4a42-b13d-f24da48872ea tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.866539 Jul 18 16:43:11.063049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 229/457] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:43:07 2022] POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments => generated 194 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:12.068978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:12.069788 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:12.077247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:12.078048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:12.079082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:12.079514 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:12.242215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:12.253270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:12.255195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:12.256631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6d4840e3-6fb1-4231-9650-2dc8db2ebdd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.192306 Jul 18 16:43:12.257186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 229/458] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:12 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:13.276384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:13.277083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:13.281038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:13.288257 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:13.288698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:13.289479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:13.289906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:13.493101 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:13.504882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:13.507199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:13.508747 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3fcc5b44-02ac-418a-876a-a7eebce43373 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.237475 Jul 18 16:43:13.509327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 230/459] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:13 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:43:14.536209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:14.537346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:14.545155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=28 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:14.553075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:14.553748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:14.555183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:14.555904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:14.732533 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:14.743312 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:14.744848 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:14.746224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3a8e1c0f-e283-43a0-8b2c-d03294554aae tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.217855 Jul 18 16:43:14.747562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 230/460] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:14 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:15.776700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:15.777594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:15.788508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:15.789228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:15.790305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:15.791167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:16.140130 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:16.157302 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:16.160870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:16.163148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9e1abc4d-e9fe-45ed-8c1e-d73a31a8033d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.392813 Jul 18 16:43:16.164312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 231/461] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:15 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:17.192559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:17.193404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:17.201023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:17.201468 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:17.202248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:17.202714 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:17.205785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:17.381343 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:17.398750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:17.402096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:17.404378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8e2a6abb-7a43-49a4-a8a6-61415f8e2818 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.215474 Jul 18 16:43:17.405744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 231/462] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:17 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:18.042476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1254872921", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "networks": [{"uuid": "7f1b0a03-df48-4d24-bcde-649f3975d3a7"}]}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:18.100115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] validate_networks() for [('7f1b0a03-df48-4d24-bcde-649f3975d3a7', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:43:18.233116 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:18.234517 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:18.243467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.244273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.245258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.245888 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.284967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-95d5b8f4-e5b8-4e29-b495-8d1272bfb85e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/ips" status: 200 len: 150 microversion: 2.1 time: 0.057081 Jul 18 16:43:18.285636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 232/463] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:43:18 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:18.299940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54f72d9f-e10c-4187-a122-dfb7feaa2c07"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:18.301857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:18.309141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.309889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.311068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.311498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.429310 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: POST /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/os-volume_attachments HTTP/1.1 Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 74 Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:43:18.431827 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {"volumeAttachment": {"volumeId": "54f72d9f-e10c-4187-a122-dfb7feaa2c07"}} Jul 18 16:43:18.434287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'server_id': 'b744aaad-a923-464c-8879-90ccec466724', 'body': {'volumeAttachment': {'volumeId': '54f72d9f-e10c-4187-a122-dfb7feaa2c07'}}} Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:18.435733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:18.437892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:18.440201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:18.440201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:18.440201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:18.440201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd Jul 18 16:43:18.440201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:18.442434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 400 to user: Invalid volume: volume 54f72d9f-e10c-4187-a122-dfb7feaa2c07 is already attached to instances: 642fda3b-e6f4-48c5-ba7f-d619553351fd {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:18.444037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b2b6402e-fdd3-45aa-8d11-8e6fe060c1a5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148809 Jul 18 16:43:18.445077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 233/464] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:43:18 2022] POST /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:43:18.453363 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:18.454192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:18.466467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.467980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.469574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.470996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.676583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:18.689889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:18.692650 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:18.694684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f20fec59-6615-44cc-a22d-7cef41e013ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.247997 Jul 18 16:43:18.695389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 234/465] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:18 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:18.699013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:43:18.699441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:43:18.700469 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:43:18.700880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:43:18.701289 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:43:18.701468 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:18.702336 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:18.714682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.716126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.717544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.717703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.719558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.721782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.723395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.724279 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.739092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Getting quotas for project 56792f3625e2457bbe9aa0dfa9763028. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:43:18.744061 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Getting quotas for user 5c7220e14fcd40c9a78bbcef1a1db5d9 and project 56792f3625e2457bbe9aa0dfa9763028. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:43:18.758653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:43:18.761122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:43:18.787379 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:43:18.820402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a9473f9e-c126-48b0-bc48-60bbc9d20811 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782275 Jul 18 16:43:18.821170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 232/466] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:43:18.827352 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:18.828833 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:18.839333 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.840068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.842021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:18.842914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:18.897460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'flavor' on Instance uuid 911b4446-c815-49de-931d-b16a8e398fe1 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:43:19.030398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1fea451e-4163-4e9d-8a16-6b1f33bacad5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 204 len: 0 microversion: 2.1 time: 0.333559 Jul 18 16:43:19.031578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 235/467] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:43:18 2022] DELETE /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:43:19.042105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e8998ab2-69a4-47fb-83f4-841d000b78fc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:19.042869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e8998ab2-69a4-47fb-83f4-841d000b78fc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:19.141691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e8998ab2-69a4-47fb-83f4-841d000b78fc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.151649 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e8998ab2-69a4-47fb-83f4-841d000b78fc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1219 microversion: 2.1 time: 0.118565 Jul 18 16:43:19.157095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 236/468] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:19.162479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:19.167123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:19.183029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.183476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.192196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.195077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.239203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1fc7bd9b-92e5-4a5a-aa7b-6c1188a19c44 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/action" status: 200 len: 32 microversion: 2.1 time: 0.415543 Jul 18 16:43:19.248667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 233/469] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:43:18 2022] POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:43:19.260454 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:19.261783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:19.276627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.279432 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.281920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.283103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.557079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.567300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.573816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-74b93f3b-323e-4c65-8820-77e32284b4a2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1683 microversion: 2.1 time: 0.415214 Jul 18 16:43:19.576143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 237/470] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1683 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:19.579395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bf6d401e-5937-475c-81be-06277d2de230 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.328697 Jul 18 16:43:19.580282 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 234/471] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:19.725295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:19.725955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:19.734230 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.735173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.737029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:19.738006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:19.919632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.930506 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.932340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:19.934386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cf8d911f-3b37-41f2-b7eb-ae32f90bbf9f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.213290 Jul 18 16:43:19.935100 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 238/472] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:19 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:20.185179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:20.186067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:20.193639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.194093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.194907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.195341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.198512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:20.270519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:20.278997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-94de7a37-4601-4fec-9c5b-2436f077ad60 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1223 microversion: 2.1 time: 0.099537 Jul 18 16:43:20.279721 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 235/473] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:20 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:20.614446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:20.615099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:20.621972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.622442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.623228 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.623662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.624611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:20.626182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:20.637154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.637918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.639939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.640702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.780553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:20.793430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0c02729b-28a0-4311-9de7-756f49881712 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1683 microversion: 2.1 time: 0.182306 Jul 18 16:43:20.794983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 239/474] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:20 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:20.875318 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:20.892178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f5f5086d-931d-433a-bc31-64870ecb047c tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.274098 Jul 18 16:43:20.893768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 236/475] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:20 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:20.966359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:20.967337 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:20.976094 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.976563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:20.977435 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:20.977815 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.011344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-d51281ce-b22e-4ffd-bb75-966a1c4e61ff req-c1df6939-7920-40dd-b1a6-393d718fe543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "name": "network-vif-plugged", "status": "completed", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:21.041144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-d51281ce-b22e-4ffd-bb75-966a1c4e61ff req-c1df6939-7920-40dd-b1a6-393d718fe543 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.042653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-d51281ce-b22e-4ffd-bb75-966a1c4e61ff req-c1df6939-7920-40dd-b1a6-393d718fe543 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.080503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-d51281ce-b22e-4ffd-bb75-966a1c4e61ff req-c1df6939-7920-40dd-b1a6-393d718fe543 service nova] Creating event network-vif-plugged:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:43:21.086180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-d51281ce-b22e-4ffd-bb75-966a1c4e61ff req-c1df6939-7920-40dd-b1a6-393d718fe543 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088310 Jul 18 16:43:21.087199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 237/476] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:21.184321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:21.193284 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:21.194832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:21.196039 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d2812756-4470-45ca-ad88-06085c58d5cd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.234311 Jul 18 16:43:21.196602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 240/477] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:20 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:21.297312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:21.298063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:21.304889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.305331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.306102 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.306562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.380286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:21.390064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2b4ff89c-1673-4822-9762-e013207ebcd1 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1215 microversion: 2.1 time: 0.097308 Jul 18 16:43:21.390964 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 238/478] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:21 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:21.820542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:21.821917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:21.836252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.837771 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.839802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.840853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.927551 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:21.929148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:21.946590 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.947904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:21.951022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:21.954843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:22.138044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.156719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-71e35ab0-5380-47eb-8986-469148e2ca59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1683 microversion: 2.1 time: 0.342858 Jul 18 16:43:22.158144 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 241/479] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:21 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1683 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:22.227246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:22.234021 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:22.249623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.279006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:22.281079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:22.287998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:22.299254 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:22.302625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d7573024-bc50-4b69-82b9-627a90a7d5e0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.385268 Jul 18 16:43:22.309558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 239/480] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:21 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:22.414630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:22.416455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:22.429677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:22.430850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:22.432605 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:22.433670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:22.608681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.638696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-013bbe8f-6f46-4594-acb1-063fb3ccd37e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1279 microversion: 2.1 time: 0.230631 Jul 18 16:43:22.654779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 240/481] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:22 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:22.919676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1647158079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1011843527", "security_groups": [{"name": "tempest-secgroup-smoke-977181763"}], "block_device_mapping_v2": [{"uuid": "6c281bd4-f88e-4d5f-838a-7c7e2855ac3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94186e07-4092-42bb-bef4-09c745cebf42"}]}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:22.930184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.948862 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.952656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:22.955254 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-25e33ee6-0a17-4601-889a-5f4b187300ba tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.741953 Jul 18 16:43:22.962575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 242/482] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:22 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:43:23.086220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] validate_networks() for [('94186e07-4092-42bb-bef4-09c745cebf42', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:43:23.192877 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:23.194376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:23.205632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:23.206686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:23.207796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:23.208404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:23.442285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:23.484388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-62976003-dcf1-4ea2-83cb-eb36488202f7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1683 microversion: 2.1 time: 0.302662 Jul 18 16:43:23.486464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 243/483] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:23 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1683 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:23.496287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:23.497747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:23.524848 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:23.525515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:23.527252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:23.527252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.064383 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:43:24.065327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:43:24.066141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:43:24.067107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:43:24.068341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:43:24.088958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.090850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.091988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.092548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.123543 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.143665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:43:24.144258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-19d402d8-1fb6-4873-b812-3a1b37cc9282 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.654817 Jul 18 16:43:24.145562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 244/484] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:23 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:24.151913 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for user 6c7e0694c5ab46a4adef7a1f7b1fed4c and project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:43:24.153388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:24.155207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:24.168586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.169877 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.171867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.172895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.300650 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.314569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-61d3911a-e00d-4faa-9c31-03c316a0f2b7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1277 microversion: 2.1 time: 0.167050 Jul 18 16:43:24.326459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 245/485] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:24 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:24.326459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:24.326459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:24.333206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.333206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.333206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.333206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.360369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:43:24.365028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c281bd4-f88e-4d5f-838a-7c7e2855ac3d',volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:43:24.659937 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.692871 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.696999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.704141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dfad4e3b-981a-4678-8c0e-5a98ffbd996e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.387223 Jul 18 16:43:24.706988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 246/486] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:24 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:24.717304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a492cded-fda6-4e51-8b3b-8625e4465127 req-599f95c8-fd9f-4302-aa22-4a828b6ac368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b744aaad-a923-464c-8879-90ccec466724", "name": "network-vif-deleted", "tag": "ca139efe-c37e-4064-a928-8621794e3268"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:24.749974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a492cded-fda6-4e51-8b3b-8625e4465127 req-599f95c8-fd9f-4302-aa22-4a828b6ac368 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.753129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a492cded-fda6-4e51-8b3b-8625e4465127 req-599f95c8-fd9f-4302-aa22-4a828b6ac368 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.816866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a492cded-fda6-4e51-8b3b-8625e4465127 req-599f95c8-fd9f-4302-aa22-4a828b6ac368 service nova] Creating event network-vif-deleted:ca139efe-c37e-4064-a928-8621794e3268 for instance b744aaad-a923-464c-8879-90ccec466724 on hv-cinder-83754 Jul 18 16:43:24.843242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-a492cded-fda6-4e51-8b3b-8625e4465127 req-599f95c8-fd9f-4302-aa22-4a828b6ac368 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128417 Jul 18 16:43:24.849216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 247/487] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:24.867897 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:24.874700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:24.887771 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.888516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.889840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:24.890606 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:24.896861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:24.981438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4d49a128-8d1a-41af-990e-e172e112f40c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.066046 Jul 18 16:43:24.998859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:24.999294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 241/488] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:43:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:43:24.999465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e87bac3e-2aec-4ccd-8297-64f190949a9b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1615 microversion: 2.1 time: 0.145028 Jul 18 16:43:24.999465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 248/489] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:24 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:25.008298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-91105582-8784-46f2-9d74-f2e2e8d5ac0c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:25.013630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-91105582-8784-46f2-9d74-f2e2e8d5ac0c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:25.158199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-91105582-8784-46f2-9d74-f2e2e8d5ac0c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:25.169824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:25.172610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:25.184330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-91105582-8784-46f2-9d74-f2e2e8d5ac0c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1095 microversion: 2.1 time: 0.176282 Jul 18 16:43:25.208276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 242/490] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:25 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1095 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:25.213613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.214459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.215554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.216558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.343627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:25.344949 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:25.354582 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.356057 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.357253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.357886 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.633728 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:25.655404 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-89db956d-64f9-4624-a29f-8ed91e6516b7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.495439 Jul 18 16:43:25.670449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 249/491] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:25 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:25.741308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:25.742219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:25.754478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.758923 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.763184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:25.766079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:25.968247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:25.982226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c44cf26f-b5ba-426a-bdd5-eeab1d642f02 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.640681 Jul 18 16:43:25.983529 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 243/492] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:25 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:26.029738 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:26.031528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:26.052162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.053826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.054651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.055104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.170024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.174851 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.175700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'fault' on Instance uuid b744aaad-a923-464c-8879-90ccec466724 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:43:26.226270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:26.238829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:26.242017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:26.245050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7c53d142-d092-42c5-b1a7-78a523af9921 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1809 microversion: 2.20 time: 0.508765 Jul 18 16:43:26.258134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 250/493] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:25 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1809 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:26.264679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:26.265667 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:26.276370 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.277266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.278974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.279624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.339191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:26.360588 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-34874699-6780-459d-a837-d72f1e90b1cc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 200 len: 1332 microversion: 2.1 time: 0.334706 Jul 18 16:43:26.370224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 244/494] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:26 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 1332 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:26.401220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:26.418965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-335aaabd-16d3-458d-bcb6-1c9e3df184a7 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1145 microversion: 2.1 time: 0.158385 Jul 18 16:43:26.424290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 251/495] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:26 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1145 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:26.677519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:26.678459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:26.687521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.688259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:26.689288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:26.689925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.015911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:27.017537 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:27.032026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.032930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.033878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.034387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.106822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.118625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-37cbc806-f7b2-4560-b8b8-beb3ed53b12f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.445015 Jul 18 16:43:27.119358 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 245/496] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:26 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:27.245908 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.256787 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-493d5818-2561-4ebb-84ae-da9c4f356785 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.249743 Jul 18 16:43:27.265849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:27.267308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:27.269717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 252/497] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:27 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:27.285660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.286555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.287581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.288222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.393632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:27.394639 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:27.410790 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.411447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.412394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.413244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.434358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 HTTP/1.1 Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:43:27.438244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:43:27.439976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'b744aaad-a923-464c-8879-90ccec466724'} Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:27.440872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:43:27.442354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:27.444832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:27.445878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2d95cda6-0c44-4fe9-aad7-a9410328d062 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 404 len: 111 microversion: 2.1 time: 0.057504 Jul 18 16:43:27.447005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 253/498] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:27 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:43:27.453775 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:27.454720 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:27.469070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.470120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.471261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.471926 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.555074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.574900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.576940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.578598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-526519e9-404d-4261-8ec2-09095f331549 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1796 microversion: 2.20 time: 0.317812 Jul 18 16:43:27.579791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 246/499] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:43:27 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1796 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:27.585610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8ca947c0-737f-49ee-961c-38dae2b787d1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '.version_select at 0x7fc3a1fbe430>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:27.610270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:27.623820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8ca947c0-737f-49ee-961c-38dae2b787d1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122693310" status: 202 len: 0 microversion: 2.1 time: 0.042643 Jul 18 16:43:27.624890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 247/500] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 18 16:43:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122693310 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:43:27.626783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f2857c07-bca8-4576-916b-bd970b3ccd62 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1211 microversion: 2.1 time: 0.178330 Jul 18 16:43:27.629498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 254/501] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:27 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1211 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:27.884931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-24637065-44c0-44f0-bd82-69be19a3200a req-92f2a3dd-76cd-42e4-877d-37c53e3567bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf052b3c-d411-47f4-b148-ce34d98d2aa3", "tag": "f8aec84e-0ae0-4a21-ae14-07199258fc70"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:27.908276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-24637065-44c0-44f0-bd82-69be19a3200a req-92f2a3dd-76cd-42e4-877d-37c53e3567bf service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:27.908723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-24637065-44c0-44f0-bd82-69be19a3200a req-92f2a3dd-76cd-42e4-877d-37c53e3567bf service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:27.930852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-24637065-44c0-44f0-bd82-69be19a3200a req-92f2a3dd-76cd-42e4-877d-37c53e3567bf service nova] Creating event network-changed:f8aec84e-0ae0-4a21-ae14-07199258fc70 for instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 on hv-cinder-83754 Jul 18 16:43:27.939868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-24637065-44c0-44f0-bd82-69be19a3200a req-92f2a3dd-76cd-42e4-877d-37c53e3567bf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062455 Jul 18 16:43:27.942268 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 248/502] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:28.144423 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:28.145999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:28.158567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.159761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.161651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.162930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.296181 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:28.298785 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:28.311292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.312073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.313037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.313684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.571029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:28.591049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-68188a04-2201-4fc9-985b-16f2f02edb54 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.454272 Jul 18 16:43:28.610647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 255/503] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:28 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:28.672575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:28.674687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:28.688726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.690957 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.692761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:28.693811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:28.926562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:28.943859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0f47cf0e-8232-4899-a9b1-b1559b8845f6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.658247 Jul 18 16:43:28.945486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 249/504] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:28 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:29.147117 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:29.304644 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:29.314631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9f4dd91c-1d7e-4397-9c38-4e0c3b71b495 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1278 microversion: 2.1 time: 0.671379 Jul 18 16:43:29.315309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 256/505] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:28 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1278 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:29.404222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:29.404874 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:29.411797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.412260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.413387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.413836 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.564901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'services' on Instance uuid 642fda3b-e6f4-48c5-ba7f-d619553351fd {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:43:29.623692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:29.624851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:29.639293 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.640631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.642119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.642899 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.733161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-57febf6f-c920-4b8b-a7a6-c5bc9e278888 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments/54f72d9f-e10c-4187-a122-dfb7feaa2c07" status: 202 len: 0 microversion: 2.1 time: 0.333146 Jul 18 16:43:29.734282 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 250/506] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:43:29 2022] DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments/54f72d9f-e10c-4187-a122-dfb7feaa2c07 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:43:29.749879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:29.751682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:29.763811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.764634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.766170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.766997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.820308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:29.828931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-de03bb96-fbce-4357-a7eb-0c548169c0b8 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087275 Jul 18 16:43:29.829911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 251/507] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:43:29 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:29.830319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a67f37f6-f099-4369-9a92-189b99b2a27f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.214003 Jul 18 16:43:29.831412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 257/508] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:29 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:29.968486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:29.969276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:29.976420 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.976866 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:29.977657 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:29.978109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.167373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:30.177176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4f4afaac-c3da-40d0-98dd-fda7e342b021 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.212862 Jul 18 16:43:30.181978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 252/509] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:29 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:30.339150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:30.339779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:30.347150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.347603 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.348388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.348822 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.725946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:30.739782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-02930eac-db2f-4f4f-b241-574807f5f83c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.405396 Jul 18 16:43:30.740746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 258/510] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:30 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:30.848608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:30.850304 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:30.858883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:30.866250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.866619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:30.867613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.869616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.871516 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.881642 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.882584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.884049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:30.885071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:30.944439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6e0f8857-a1f4-4f6f-a4ce-15ac271bc15e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104733 Jul 18 16:43:30.977166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 253/511] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:43:30 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:31.204121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:31.210850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:31.250559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:31.254374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:31.258184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:31.259631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:31.260413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:31.281488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b8186ec4-7fb9-4168-bca9-b8b18650376b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.428260 Jul 18 16:43:31.282930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 259/512] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:30 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:31.744780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:31.748987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:31.765170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:31.766890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:31.780023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9c64fc7d-f7bd-4682-8c13-e6bf26edf1bc tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.587559 Jul 18 16:43:31.782539 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:31.784022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:31.786017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:31.787659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:31.800810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 254/513] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:31 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:31.957524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-f1ed06fe-6515-4162-9c72-d16b39a8b225 req-6508f6d9-83dc-46db-8603-66d59d0e3fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c69462-5393-447e-96d5-cda144e8d328", "tag": "b74452ca-033c-40d3-b50d-968df23f2d86"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:31.986194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f1ed06fe-6515-4162-9c72-d16b39a8b225 req-6508f6d9-83dc-46db-8603-66d59d0e3fec service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:31.987418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f1ed06fe-6515-4162-9c72-d16b39a8b225 req-6508f6d9-83dc-46db-8603-66d59d0e3fec service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.030251 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-f1ed06fe-6515-4162-9c72-d16b39a8b225 req-6508f6d9-83dc-46db-8603-66d59d0e3fec service nova] Creating event network-changed:b74452ca-033c-40d3-b50d-968df23f2d86 for instance 59c69462-5393-447e-96d5-cda144e8d328 on hv-cinder-83754 Jul 18 16:43:32.051601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-f1ed06fe-6515-4162-9c72-d16b39a8b225 req-6508f6d9-83dc-46db-8603-66d59d0e3fec service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102587 Jul 18 16:43:32.052740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 255/514] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:32.079090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:32.081225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:32.107169 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.121740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.123309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.126261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.191135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:32.191630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ed10a56d-cfc8-4d01-9f3c-afa52c7f481d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130053 Jul 18 16:43:32.192820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 256/515] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:43:32 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:43:32.208251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e0828f5a-dae7-492a-b429-e93d15edd412 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.449003 Jul 18 16:43:32.222423 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 260/516] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:31 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:32.270191 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:32.270879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:32.281845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.282351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.283261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.283850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.318347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:32.319470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:32.322519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:43:32.329640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.333549 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.335155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.336099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.467479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ef9541c1-c99e-4811-b775-69c422cb94fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 204 len: 0 microversion: 2.1 time: 0.200160 Jul 18 16:43:32.468166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 257/517] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:43:32 2022] DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:43:32.477634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:32.478724 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:32.486634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.487775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.488549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.489020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.584059 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:32.599000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-22dcacc7-0f2a-425c-b22f-5e809de56920 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.286658 Jul 18 16:43:32.600769 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 261/518] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:32 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:32.687724 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:32.696461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e9465304-b16a-499e-8114-973c6edd9a8d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1681 microversion: 2.1 time: 0.223442 Jul 18 16:43:32.697071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 258/519] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:32 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:32.812466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:32.813045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:32.823048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.824409 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:32.826005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:32.826804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.014060 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:33.022321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8eccfcf8-1378-44e9-b58b-02a898a9cfd9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.214026 Jul 18 16:43:33.023093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 262/520] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:32 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:33.186910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-ecfc2528-6c74-478b-9199-99fa4072e1d6 req-89fb7e26-bf67-4d0a-b9a2-8e8cfc430895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf052b3c-d411-47f4-b148-ce34d98d2aa3", "name": "network-vif-plugged", "status": "completed", "tag": "f8aec84e-0ae0-4a21-ae14-07199258fc70"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:33.194037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:33.206943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-ecfc2528-6c74-478b-9199-99fa4072e1d6 req-89fb7e26-bf67-4d0a-b9a2-8e8cfc430895 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.207721 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-ecfc2528-6c74-478b-9199-99fa4072e1d6 req-89fb7e26-bf67-4d0a-b9a2-8e8cfc430895 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.229802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:33.231126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:33.231610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-ecfc2528-6c74-478b-9199-99fa4072e1d6 req-89fb7e26-bf67-4d0a-b9a2-8e8cfc430895 service nova] Creating event network-vif-plugged:f8aec84e-0ae0-4a21-ae14-07199258fc70 for instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 on hv-cinder-83754 Jul 18 16:43:33.242885 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.243217 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-ecfc2528-6c74-478b-9199-99fa4072e1d6 req-89fb7e26-bf67-4d0a-b9a2-8e8cfc430895 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064546 Jul 18 16:43:33.244943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 259/521] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:33.251310 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.253378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.254748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.443904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:33.457407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0458418a-1745-40cb-8e62-8119c81fa7a8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.233899 Jul 18 16:43:33.458182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 263/522] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:33 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:33.625583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:33.626253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:33.634260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.634732 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.635507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.635935 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.718355 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:33.725737 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:33.737453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.738239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.739739 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:33.740546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:33.795428 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:33.810237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-97fa9ea5-436c-4a1c-8fde-a071bd05635a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.189590 Jul 18 16:43:33.811335 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 260/523] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:33 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:33.955439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:33.967320 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e876060e-db48-4eca-a539-2b93bceccfde tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1681 microversion: 2.1 time: 0.257059 Jul 18 16:43:33.967897 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 264/524] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:33 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:34.043526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:34.044185 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:34.051017 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.051464 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.052239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.052663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.110911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:34.241890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:34.252377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dda565e5-db82-488c-80cb-2d096db5ca7b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.213445 Jul 18 16:43:34.253306 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 261/525] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:34 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:34.474752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:34.475384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:34.482323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.482806 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.483595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.484033 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.500809 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:34.661793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:34.671763 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bd26f279-2e2b-41cf-89fa-b92c065aae05 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.201064 Jul 18 16:43:34.672587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 265/526] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:34 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:34.831930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:34.832538 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:34.839650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.840091 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.840861 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.841288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.985449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:34.986230 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:34.993363 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.993825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.994746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:34.995107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:34.998530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:35.008461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9c50d2a0-3ac2-4b42-b11a-0b4a0cec2f49 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.180794 Jul 18 16:43:35.009254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 262/527] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:34 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:35.280480 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:35.284159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:35.291480 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=14 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:35.293799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:35.315312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:35.316281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:35.317569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7e71cab7-b380-475e-a392-6fa46bb3804b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1681 microversion: 2.1 time: 0.335994 Jul 18 16:43:35.318167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:35.319146 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:35.332167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 266/528] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:34 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:35.693974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:35.695306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:35.700491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:35.708579 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:35.709707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:35.710148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9a9da682-436a-4662-b1a3-a9090c386771 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.440961 Jul 18 16:43:35.718475 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:35.718475 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:35.721454 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 263/529] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:35 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:35.874737 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:35.883268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c516011f-5eb4-49a0-9189-01a1089cb677 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.196452 Jul 18 16:43:35.883942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 267/530] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:35 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:36.034767 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:36.035384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:36.046756 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.047267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.048009 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.049995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.284222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:36.295986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-110aba44-3140-472d-a6e6-edf07e4463f3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.264906 Jul 18 16:43:36.300219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 264/531] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:36 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:36.349116 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:36.350248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:36.362766 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.363574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.365076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.365870 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.472047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:36.495242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9a9cc804-33ee-4377-ad21-e317894698ee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1613 microversion: 2.1 time: 0.153268 Jul 18 16:43:36.499230 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 268/532] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:36 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1613 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:36.704684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-33245e7a-e2a6-405c-a42f-d215ccc0ab23 req-02732470-b43c-41ad-a8c4-1851c4ea006a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642fda3b-e6f4-48c5-ba7f-d619553351fd", "name": "network-vif-deleted", "tag": "a4fdf947-4005-4728-8f93-b30af2b7db4b"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:36.714641 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-33245e7a-e2a6-405c-a42f-d215ccc0ab23 req-02732470-b43c-41ad-a8c4-1851c4ea006a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.715106 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-33245e7a-e2a6-405c-a42f-d215ccc0ab23 req-02732470-b43c-41ad-a8c4-1851c4ea006a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.730555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-33245e7a-e2a6-405c-a42f-d215ccc0ab23 req-02732470-b43c-41ad-a8c4-1851c4ea006a service nova] Creating event network-vif-deleted:a4fdf947-4005-4728-8f93-b30af2b7db4b for instance 642fda3b-e6f4-48c5-ba7f-d619553351fd on hv-cinder-83754 Jul 18 16:43:36.734929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:36.736466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:36.737083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-33245e7a-e2a6-405c-a42f-d215ccc0ab23 req-02732470-b43c-41ad-a8c4-1851c4ea006a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 Jul 18 16:43:36.738286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 265/533] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:36.755057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.756012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.757537 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.758441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.909830 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:36.910771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:36.919180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.920059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.920909 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:36.921344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:36.943557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:36.958040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f3c3106a-55d9-4621-a3db-18fc28cd92a4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1319 microversion: 2.1 time: 0.231717 Jul 18 16:43:36.958883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 269/534] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:36 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:37.137712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:37.149002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-efefc66f-6a6d-4ede-ba00-7096aaa8cb00 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.244582 Jul 18 16:43:37.149745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 266/535] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:36 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:37.315911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:37.316879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:37.326916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.328059 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.329473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.330055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.534493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:37.537328 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:37.553417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.554699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.557014 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.562114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:37.562986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.571767 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-68a5c8a1-5893-4376-a4e3-ec214730c434 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.260282 Jul 18 16:43:37.572882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 270/536] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:37 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:37.613702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.614167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.614709 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'fault' on Instance uuid 642fda3b-e6f4-48c5-ba7f-d619553351fd {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:43:37.674822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:37.684506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cd1d3eb4-da3e-41d8-b236-7469363d5207 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 200 len: 1331 microversion: 2.1 time: 0.161434 Jul 18 16:43:37.685503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 267/537] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:37 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:37.983204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:37.984381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:37.993702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.994635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:37.996306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:37.996916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.169015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:38.169637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:38.185550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.186394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.187473 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.188137 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.223572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:38.232690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-38af90fe-6112-4f19-aec3-071334fb8d49 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1509 microversion: 2.1 time: 0.255379 Jul 18 16:43:38.233285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 271/538] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:37 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:38.387654 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:38.397801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5ac6c8ba-ec28-42f5-98c4-50ec958b867d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.233423 Jul 18 16:43:38.398808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 268/539] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:38 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:38.594360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:38.595478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:38.606716 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.607335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.608767 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.609493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.704069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:38.704990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:38.712384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.713202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.714143 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:38.715250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:38.731262 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd HTTP/1.1 Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:43:38.733846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:43:38.735283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '642fda3b-e6f4-48c5-ba7f-d619553351fd'} Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:38.736316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:43:38.737493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:43:38.740115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:38.741194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9908b0d4-eada-4417-bedc-13372c4de336 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 404 len: 111 microversion: 2.1 time: 0.041539 Jul 18 16:43:38.745659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 269/540] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:38 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:43:38.762184 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-89bb6879-3595-4d2e-8378-6e7caf3fe8e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '.version_select at 0x7fc3a207bd30>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:38.797442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-89bb6879-3595-4d2e-8378-6e7caf3fe8e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814395262" status: 202 len: 0 microversion: 2.1 time: 0.049096 Jul 18 16:43:38.799218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 270/541] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 18 16:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814395262 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:43:38.826682 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:38.854324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-10a9227e-a072-4e38-8833-921be5c368bc tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.267108 Jul 18 16:43:38.855639 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 272/542] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:38 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:39.423316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:39.424865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:39.435481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:39.436373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:39.438144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:39.439262 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:39.749421 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7ffcde6e-5cca-4d47-af5f-cc14896267b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: .version_select at 0x7fc3a1f1da60>, body: {"keypair": {"name": "tempest-keypair-1361800702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ4hUBw4SeR8cTdaoOxuLyCUnBiInYYMtAICcKGvRgRXHMVXiQBBEoDi8K+mUc7wsm7z9+CLSl/mFtyBxwilbAkJ2MbgWSTOP/zQ3zyFBaHWX1wFLLVAQh2fkqV0vfl8A=="}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:39.760653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:39.770430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-7ffcde6e-5cca-4d47-af5f-cc14896267b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:43:39.770891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-68976247-67c6-4f8d-a325-063604030573 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.356056 Jul 18 16:43:39.771637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 271/543] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:39 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:39.778147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-7ffcde6e-5cca-4d47-af5f-cc14896267b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:43:39.784245 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:39.814375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7ffcde6e-5cca-4d47-af5f-cc14896267b2 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070754 Jul 18 16:43:39.815013 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 273/544] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:43:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:39.887129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:39.888961 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:39.905392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:39.906044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:39.907662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:39.908952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:40.144859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:40.161363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5e0866de-e195-46c0-8296-467376caebb1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.282961 Jul 18 16:43:40.162389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 272/545] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:39 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:40.799942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:40.801017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:40.811134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:40.811853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:40.812847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:40.813599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:41.159485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:41.169202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-42b2963e-43ad-4198-8fff-ad4e237b579d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.375368 Jul 18 16:43:41.182848 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 274/546] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:40 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:41.200115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:41.200962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:41.208344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:41.208807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:41.209656 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:41.210189 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:41.216121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:41.511290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:41.525776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-98236b9f-1476-48e4-be77-f5c17d205308 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.330181 Jul 18 16:43:41.526606 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 273/547] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:41 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:41.988536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-792656758", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "509e7a9e-2f1a-47ea-a4fb-2e64a591cc67"}], "security_groups": [{"name": "tempest-securitygroup--1406885568"}], "key_name": "tempest-keypair-1361800702", "user_data": "}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:42.152106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] validate_networks() for [('509e7a9e-2f1a-47ea-a4fb-2e64a591cc67', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:43:42.193699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:42.194781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:42.202161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.203110 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.203645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.204186 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.372287 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:42.380863 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-08d2ccaf-3962-4495-89e0-a11747c68561 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.191183 Jul 18 16:43:42.381587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 274/548] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:42 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:42.555921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:42.556677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:42.567441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.568248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.569254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.570147 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.773649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:42.791459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8e694c45-f239-479c-a6c8-9f9865f869d2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.238907 Jul 18 16:43:42.793187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 275/549] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:42 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:42.850389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:43:42.851015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:43:42.851785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:43:42.852291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:43:42.852925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:43:42.866865 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.867369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.868229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.868799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.889047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:43:42.894175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:43:42.908088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:43:42.910518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:43:42.978441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0991d49e-cde0-4016-ab39-cf6ad825def7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.995534 Jul 18 16:43:42.980567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 275/550] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:43:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:43:43.001681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-35e0e9c1-cae7-45df-bc1c-13945186d514 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:43.003395 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-35e0e9c1-cae7-45df-bc1c-13945186d514 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:43.146210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-35e0e9c1-cae7-45df-bc1c-13945186d514 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:43.164545 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-35e0e9c1-cae7-45df-bc1c-13945186d514 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1241 microversion: 2.1 time: 0.173276 Jul 18 16:43:43.166829 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 276/551] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:42 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:43.420122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:43.421261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:43.436960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.437964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:43.440133 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.441204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:43.647580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:43.659493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-53c4c3dd-c461-4af7-9a11-a43908b975ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.261708 Jul 18 16:43:43.660241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 276/552] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:43 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:43.822154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:43.822806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:43.830353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.830862 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:43.831636 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.832078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:44.049948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:44.064957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-94eaa39f-87ed-4752-aa98-5a4611830579 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1732 microversion: 2.1 time: 0.246924 Jul 18 16:43:44.065940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 277/553] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:43 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:44.198228 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:44.199101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:44.206557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:44.207252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:44.208951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:44.209751 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:44.310960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:44.319592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f36e9b7f-8eeb-4793-b79f-fbe76ab1aff1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1237 microversion: 2.1 time: 0.127406 Jul 18 16:43:44.320492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 277/554] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:44 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:44.677705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:44.678334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:44.685038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:44.685487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:44.686273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:44.686744 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:44.884486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:44.900024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-109745dc-ebd8-433f-8e33-42eac00db6c2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.225616 Jul 18 16:43:44.901318 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 278/555] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:44 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:45.084891 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:45.085675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:45.095240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.096049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.097549 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.098082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.274733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:45.285706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4942f8b3-83ad-4d70-b3a5-be6e1aeb1bd2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1712 microversion: 2.1 time: 0.204802 Jul 18 16:43:45.287018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 278/556] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:45 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1712 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:45.344921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:45.359312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:45.376776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.377227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.378025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.378495 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.506452 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:45.507236 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:45.527123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:45.537138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.538128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.539752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.542930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9ea1326a-494c-42c3-a7cc-cf56d2fecf54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1293 microversion: 2.1 time: 0.207452 Jul 18 16:43:45.543289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.544932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 279/557] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:45 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:45.583223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-e3032418-50a4-4001-a4cc-48258ab2877c req-3442955c-1678-4777-867b-8078f7182a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c69462-5393-447e-96d5-cda144e8d328", "name": "network-vif-plugged", "status": "completed", "tag": "b74452ca-033c-40d3-b50d-968df23f2d86"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:45.597505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e3032418-50a4-4001-a4cc-48258ab2877c req-3442955c-1678-4777-867b-8078f7182a4a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.598281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e3032418-50a4-4001-a4cc-48258ab2877c req-3442955c-1678-4777-867b-8078f7182a4a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.614577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-e3032418-50a4-4001-a4cc-48258ab2877c req-3442955c-1678-4777-867b-8078f7182a4a service nova] Creating event network-vif-plugged:b74452ca-033c-40d3-b50d-968df23f2d86 for instance 59c69462-5393-447e-96d5-cda144e8d328 on hv-cinder-83754 Jul 18 16:43:45.623893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-e3032418-50a4-4001-a4cc-48258ab2877c req-3442955c-1678-4777-867b-8078f7182a4a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047171 Jul 18 16:43:45.625199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 280/558] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:45.920242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:45.921879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:45.938570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.940778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:45.947461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:45.948338 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.127248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] HTTP exception thrown: Cannot 'detach_volume' instance 911b4446-c815-49de-931d-b16a8e398fe1 while it is in vm_state rescued Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Request method failure captured: Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments/88ac62ce-7db1-4370-a328-40d73f459f96 HTTP/1.1 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy1eX-DjPkyYdfnoJYxaGVNuSu5eYPnaCDDJiLy71EiuUZ5EroXnuvt9Lbnqb_iJPqF6LMIxC35i6j-CjWZ5IeuSN5G7juDyVJl7fFX5mn1dyYmq52fmfXDa_SzJgi3hM7Ut-o955Ff2WciO_ZQOnmk2xLGDuskaOC_u2TuJu_Qq1E Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:43:46.130002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/afb65421f9504a918b7a47451fac6707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_afb65421f9504a918b7a47451fac6707", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: ab3be59ea4c74da3b4e19273102bccd9 Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:43:46.132510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Cannot 'detach_volume' instance 911b4446-c815-49de-931d-b16a8e398fe1 while it is in vm_state rescued Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'server_id': '911b4446-c815-49de-931d-b16a8e398fe1', 'id': '88ac62ce-7db1-4370-a328-40d73f459f96'} Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 911b4446-c815-49de-931d-b16a8e398fe1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:46.133745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 911b4446-c815-49de-931d-b16a8e398fe1 while it is in vm_state rescued Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 911b4446-c815-49de-931d-b16a8e398fe1 while it is in vm_state rescued Jul 18 16:43:46.136656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:43:46.139985 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Returning 409 to user: Cannot 'detach_volume' instance 911b4446-c815-49de-931d-b16a8e398fe1 while it is in vm_state rescued {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:46.141814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c1bca4f9-3ee1-4263-a7d1-3ee3f99ae6b5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments/88ac62ce-7db1-4370-a328-40d73f459f96" status: 409 len: 152 microversion: 2.1 time: 0.639489 Jul 18 16:43:46.148155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:46.149125 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 279/559] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:43:45 2022] DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments/88ac62ce-7db1-4370-a328-40d73f459f96 => generated 152 bytes in 648 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:43:46.160043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9cabcc59-3940-4f21-9f6f-90d8f0b9562f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.243869 Jul 18 16:43:46.161546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 281/560] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:45 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:46.162795 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:46.163779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:46.176115 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.177323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.179065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.180688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.313099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-32aa5e2f-4178-46ce-9769-c870bfa0c507 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/action" status: 202 len: 0 microversion: 2.1 time: 0.161259 Jul 18 16:43:46.318616 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 280/561] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:43:46 2022] POST /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:43:46.328084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:46.329575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:46.342716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.343885 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.346161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.347198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.553811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:46.564638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e4c9af4f-d55a-487e-beeb-318a46087fde tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1720 microversion: 2.1 time: 0.244377 Jul 18 16:43:46.567579 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 282/562] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:46 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:46.580420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:46.582679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:46.593408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.594115 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.595216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:46.595948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:46.716695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:46.727065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cfe53a9a-25a6-4b87-8e87-f73971a76f70 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1299 microversion: 2.1 time: 0.154410 Jul 18 16:43:46.728030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 281/563] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:46 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:47.191505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:47.192433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:47.203368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.204142 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:47.205726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.206740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:47.560129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:47.573225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6b076737-ae62-4e80-ab1f-1122e7e68ff9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1266 microversion: 2.1 time: 0.389997 Jul 18 16:43:47.597863 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:47.600698 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:47.601220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 283/564] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:47 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:47.615441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.616829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:47.619352 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.621056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:47.762980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:47.764397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:47.775487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.777292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:47.779007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:47.779846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:48.054600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:48.058661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:48.075853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-47d32f9c-5a6f-4d01-abfc-37cc091e31d7 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1720 microversion: 2.1 time: 0.488327 Jul 18 16:43:48.077356 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 282/565] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:47 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1720 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:48.099146 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:48.109573 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e2b5b8af-5d91-40d2-93ae-b2e96a93d449 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.355620 Jul 18 16:43:48.121059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 284/566] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:47 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:48.615735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:48.618793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:48.640875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:48.656618 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:48.658853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:48.659563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:48.775613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-5ca30936-9e73-4cfd-86fa-616f96723cf4 req-43343490-1be0-4d99-832d-89c6f15b5014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2041fced-2b7e-4c58-998e-a14e43cd2707", "tag": "f048385e-e6ad-453d-9a07-98ed65178acc"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:48.798020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-5ca30936-9e73-4cfd-86fa-616f96723cf4 req-43343490-1be0-4d99-832d-89c6f15b5014 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:48.799687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-5ca30936-9e73-4cfd-86fa-616f96723cf4 req-43343490-1be0-4d99-832d-89c6f15b5014 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:48.833458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-5ca30936-9e73-4cfd-86fa-616f96723cf4 req-43343490-1be0-4d99-832d-89c6f15b5014 service nova] Creating event network-changed:f048385e-e6ad-453d-9a07-98ed65178acc for instance 2041fced-2b7e-4c58-998e-a14e43cd2707 on hv-cinder-83754 Jul 18 16:43:48.853821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-5ca30936-9e73-4cfd-86fa-616f96723cf4 req-43343490-1be0-4d99-832d-89c6f15b5014 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082574 Jul 18 16:43:48.855414 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 285/567] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:49.113646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:49.115705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:49.135577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.137149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.138993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.139892 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.203906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:49.217461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8319f26b-d4a9-413c-bfa2-88c7f61d882c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1454 microversion: 2.1 time: 0.611046 Jul 18 16:43:49.218040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 283/568] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:48 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1454 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:49.226341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:49.227037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:49.245508 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.246122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.246950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.247521 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.385813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:49.402052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-57fdfe38-2c2c-4c9b-9fc9-8c433d310689 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1720 microversion: 2.1 time: 0.298512 Jul 18 16:43:49.402690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 286/569] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:49 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:49.408320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:49.409247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:49.419635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.420084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.421109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:49.421553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:49.514275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:49.523797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c226e2cd-2eab-4e8f-9b59-6b97a454b53b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.304410 Jul 18 16:43:49.524491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 284/570] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:49 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:49.598831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:49.608057 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ca8ea10f-88e4-47b6-81b8-96f2707fecaf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1454 microversion: 2.1 time: 0.203941 Jul 18 16:43:49.608661 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 287/571] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:49 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1454 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:50.419342 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:50.420038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:50.427714 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:50.428195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:50.429162 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:50.429606 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:50.543649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:50.545082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:50.554776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:50.556274 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:50.562022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:50.564478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:50.627730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:50.653407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-80f42850-d5f2-4c88-aa5c-996a6998d22a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1720 microversion: 2.1 time: 0.237695 Jul 18 16:43:50.654808 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 285/572] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:50 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:50.843308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:50.851801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-38dd61b1-f4df-457b-bca0-4aa4278d8fe7 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.314414 Jul 18 16:43:50.852403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 288/573] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:50 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:51.671855 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:51.672776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:51.680050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:51.680818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:51.682008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:51.682523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:51.877966 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:51.880135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:51.896598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:51.897626 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:51.899402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:51.900430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:51.929192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:51.944441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-145a4e40-2777-4818-80ab-0ff1119b096f tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1720 microversion: 2.1 time: 0.276823 Jul 18 16:43:51.946577 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 286/574] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:51 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1720 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:52.669193 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:52.677413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3be268a0-875b-44fe-a9f5-5a2410d28174 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.810252 Jul 18 16:43:52.678295 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 289/575] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:51 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:52.974239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:52.975497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:52.982007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:52.988310 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=10 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:52.992760 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:52.993488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:52.994070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:52.994581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:53.002806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-55437383-3244-42c2-8032-a2c788779459 req-4a91c734-f040-4c89-8ddc-9c94b085916e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c69462-5393-447e-96d5-cda144e8d328", "tag": "b74452ca-033c-40d3-b50d-968df23f2d86"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:53.030973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-55437383-3244-42c2-8032-a2c788779459 req-4a91c734-f040-4c89-8ddc-9c94b085916e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:53.032412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-55437383-3244-42c2-8032-a2c788779459 req-4a91c734-f040-4c89-8ddc-9c94b085916e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:53.069330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-55437383-3244-42c2-8032-a2c788779459 req-4a91c734-f040-4c89-8ddc-9c94b085916e service nova] Creating event network-changed:b74452ca-033c-40d3-b50d-968df23f2d86 for instance 59c69462-5393-447e-96d5-cda144e8d328 on hv-cinder-83754 Jul 18 16:43:53.084402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-55437383-3244-42c2-8032-a2c788779459 req-4a91c734-f040-4c89-8ddc-9c94b085916e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086205 Jul 18 16:43:53.090018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 290/576] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:53.266812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:53.282156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f1a73b05-4947-4906-8ce0-6b2440982083 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1726 microversion: 2.1 time: 0.312522 Jul 18 16:43:53.283030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 287/577] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:52 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1726 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:53.311730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:53.312857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:53.316227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:53.326186 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:53.327090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:53.329092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:53.330498 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:53.456753 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5a62f83f-62d9-4637-bf8c-e66148a3710e tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151193 Jul 18 16:43:53.457357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 291/578] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:43:53 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:53.694847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:53.695955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:53.703470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:53.704278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:53.705092 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:53.705535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:54.126530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:54.150210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e75696fb-496f-41d1-be1a-9ef7c483c537 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.459091 Jul 18 16:43:54.150835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 288/579] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:53 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:43:55.186349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:55.193682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:55.219791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:55.221704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:55.226459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:55.227933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:55.493287 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:55.502824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-15021e2e-2e0c-42d4-b8f4-9cb6ec9c9e88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.326117 Jul 18 16:43:55.503838 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 292/580] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:55 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:55.853626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-e7f17f3f-c606-4a16-861b-38c03b21b9b8 req-d692e62f-f34e-45eb-b632-a1ca4af28a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:55.863864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e7f17f3f-c606-4a16-861b-38c03b21b9b8 req-d692e62f-f34e-45eb-b632-a1ca4af28a61 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:55.864685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e7f17f3f-c606-4a16-861b-38c03b21b9b8 req-d692e62f-f34e-45eb-b632-a1ca4af28a61 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:55.877585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-e7f17f3f-c606-4a16-861b-38c03b21b9b8 req-d692e62f-f34e-45eb-b632-a1ca4af28a61 service nova] Creating event network-changed:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:43:55.884141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-e7f17f3f-c606-4a16-861b-38c03b21b9b8 req-d692e62f-f34e-45eb-b632-a1ca4af28a61 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034662 Jul 18 16:43:55.885095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 289/581] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:56.524810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:56.527821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:56.540903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:56.542623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:56.544340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:56.545407 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:56.554706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:56.800216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:56.819423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-76a054fe-a51e-408f-b55b-ea9073b98dca tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.300167 Jul 18 16:43:56.835862 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 293/582] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:56 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:57.849753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:57.850883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:57.859447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:57.860040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:57.861075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:57.861616 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:57.901971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-c90f068a-5b07-48ed-905a-df33a6d086d1 req-4b337576-2b54-4a50-ba75-0b0fca75d994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:57.911699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-c90f068a-5b07-48ed-905a-df33a6d086d1 req-4b337576-2b54-4a50-ba75-0b0fca75d994 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:57.912393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-c90f068a-5b07-48ed-905a-df33a6d086d1 req-4b337576-2b54-4a50-ba75-0b0fca75d994 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:57.933459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-c90f068a-5b07-48ed-905a-df33a6d086d1 req-4b337576-2b54-4a50-ba75-0b0fca75d994 service nova] Creating event network-changed:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:43:57.944672 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-c90f068a-5b07-48ed-905a-df33a6d086d1 req-4b337576-2b54-4a50-ba75-0b0fca75d994 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045993 Jul 18 16:43:57.945782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 294/583] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:43:58.126566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:58.135808 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3d990fb0-33c4-426c-ba9b-1d40f8e8a784 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.291683 Jul 18 16:43:58.137132 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 290/584] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:57 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:58.169973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-951b6f9d-7605-4ca5-a0bb-348c8a977652 req-2af17604-eb75-4e63-98b4-5bf876848a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2041fced-2b7e-4c58-998e-a14e43cd2707", "name": "network-vif-plugged", "status": "completed", "tag": "f048385e-e6ad-453d-9a07-98ed65178acc"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:58.179262 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-951b6f9d-7605-4ca5-a0bb-348c8a977652 req-2af17604-eb75-4e63-98b4-5bf876848a5c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:58.180024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-951b6f9d-7605-4ca5-a0bb-348c8a977652 req-2af17604-eb75-4e63-98b4-5bf876848a5c service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:58.201133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-951b6f9d-7605-4ca5-a0bb-348c8a977652 req-2af17604-eb75-4e63-98b4-5bf876848a5c service nova] Creating event network-vif-plugged:f048385e-e6ad-453d-9a07-98ed65178acc for instance 2041fced-2b7e-4c58-998e-a14e43cd2707 on hv-cinder-83754 Jul 18 16:43:58.206677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-951b6f9d-7605-4ca5-a0bb-348c8a977652 req-2af17604-eb75-4e63-98b4-5bf876848a5c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042067 Jul 18 16:43:58.207345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 295/585] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:59.162195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:59.163112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:43:59.172356 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:59.172924 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:59.174260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:59.174844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:59.343643 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:43:59.352201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f086b963-c8a0-4553-b56b-ea9de85754c0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.193852 Jul 18 16:43:59.352784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 291/586] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:43:59 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:00.383759 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:00.386555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:00.400088 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:00.401741 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:00.403375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:00.404550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:00.640679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "753ead6b-e7e5-4fa9-a95c-de2aeb78f4b5", "device": "/dev/sdb"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:00.642687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:00.643002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:00.650564 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:00.651790 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:00.652697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:00.653235 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:00.655792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b8f84ec4-1616-49c6-9d73-277b80113501 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1367 microversion: 2.1 time: 0.281153 Jul 18 16:44:00.656777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 296/587] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:00 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:01.383280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-01eca990-2da5-4a91-a6db-064a9474ca6b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "POST /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746951 Jul 18 16:44:01.383970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 292/588] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:44:00 2022] POST /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:44:01.677086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.677728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:01.684664 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:01.685116 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:01.685903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:01.686366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:01.851692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:01.861461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7335a698-8d69-443c-a82f-b0531723e7e3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1557 microversion: 2.1 time: 0.188366 Jul 18 16:44:01.862314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 297/589] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:01.879916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:01.880503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:01.887695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:01.888154 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:01.888948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:01.889380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:01.984135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6b0b2091-07b3-4dc7-96a9-00affd47ed4a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108961 Jul 18 16:44:01.985124 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 293/590] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:44:01 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:03.620203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-69ee54a4-51fc-4c58-a4f6-ca0f1387f965 req-733a8ab3-25b9-4cca-89b0-c5f65bb5495a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2041fced-2b7e-4c58-998e-a14e43cd2707", "tag": "f048385e-e6ad-453d-9a07-98ed65178acc"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:03.629665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-69ee54a4-51fc-4c58-a4f6-ca0f1387f965 req-733a8ab3-25b9-4cca-89b0-c5f65bb5495a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:03.630110 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-69ee54a4-51fc-4c58-a4f6-ca0f1387f965 req-733a8ab3-25b9-4cca-89b0-c5f65bb5495a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:03.649997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-69ee54a4-51fc-4c58-a4f6-ca0f1387f965 req-733a8ab3-25b9-4cca-89b0-c5f65bb5495a service nova] Creating event network-changed:f048385e-e6ad-453d-9a07-98ed65178acc for instance 2041fced-2b7e-4c58-998e-a14e43cd2707 on hv-cinder-83754 Jul 18 16:44:03.657921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-69ee54a4-51fc-4c58-a4f6-ca0f1387f965 req-733a8ab3-25b9-4cca-89b0-c5f65bb5495a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041593 Jul 18 16:44:03.658895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 298/591] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:26.536525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:26.537291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:26.542874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:26.543367 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:26.551920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:26.552408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:26.553278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:26.554005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:26.787948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:26.789230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=23 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:26.932237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lazy-loading 'services' on Instance uuid cf052b3c-d411-47f4-b148-ce34d98d2aa3 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:26.991977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:26.992563 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:26.999985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.000425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.001224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.001670 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.036753 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a4cc4235-b376-4bd5-87d5-8bffce8f70c3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments/fa32b647-90cd-46ce-9040-2320018a9255" status: 200 len: 194 microversion: 2.20 time: 0.250938 Jul 18 16:44:27.037692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 299/592] 10.222.0.77 () {60 vars in 1453 bytes} [Mon Jul 18 16:44:26 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments/fa32b647-90cd-46ce-9040-2320018a9255 => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:44:27.114820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6ff1e7de-024e-441c-b0ab-f4b47c22cce4 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3/os-volume_attachments/753ead6b-e7e5-4fa9-a95c-de2aeb78f4b5" status: 202 len: 0 microversion: 2.1 time: 0.579393 Jul 18 16:44:27.115651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 294/593] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:44:26 2022] DELETE /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3/os-volume_attachments/753ead6b-e7e5-4fa9-a95c-de2aeb78f4b5 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:44:27.117159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:27.117674 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:27.126673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.127662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.128589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.128901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.313945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lazy-loading 'services' on Instance uuid 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:27.396104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5cbffabe-2a30-49a8-a18f-921701440645 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments/fa32b647-90cd-46ce-9040-2320018a9255" status: 202 len: 0 microversion: 2.20 time: 0.284159 Jul 18 16:44:27.396743 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 300/594] 10.222.0.77 () {60 vars in 1456 bytes} [Mon Jul 18 16:44:27 2022] DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments/fa32b647-90cd-46ce-9040-2320018a9255 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:44:27.406462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:27.408240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:27.415520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.415960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.416735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:27.417186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:27.452909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c75054a9-18c7-4c33-9e30-faf9a9bd191a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050845 Jul 18 16:44:27.453635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 295/595] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:44:27 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:44:28.466051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:28.467086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:28.473863 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:28.474305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:28.475272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:28.475703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:28.514811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a403051c-e465-4651-8a37-d0b8d25bf95f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053195 Jul 18 16:44:28.515392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 301/596] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:44:28 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:29.324801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:29.325574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:29.332192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.332634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.333414 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.333842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.363652 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:44:29.468220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-540bbde3-5518-4288-871a-0a93ea8a813a tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 204 len: 0 microversion: 2.1 time: 0.146331 Jul 18 16:44:29.469774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 296/597] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:44:29 2022] DELETE /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:44:29.483260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:29.484439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:29.493663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.494621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.495981 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.496831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.533094 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:29.534523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:29.543139 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.543763 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.545045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:29.545662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:29.588670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d7de6274-d36c-49d6-b839-ce47e7a29d60 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061539 Jul 18 16:44:29.589559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 297/598] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:44:29 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:44:29.727398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:29.736763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6da1de2b-cf83-4928-8266-37e596feb899 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1515 microversion: 2.1 time: 0.260440 Jul 18 16:44:29.737356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 302/599] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:29 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:30.602689 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:30.603505 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:30.610389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:30.610876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:30.611784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:30.612115 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:30.645354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ccb8a941-c9cb-4d1c-b133-2eea2e5fbd0b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046760 Jul 18 16:44:30.645957 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 298/600] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:44:30 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:30.755687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:30.756390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:30.764615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:30.765226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:30.766135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:30.766716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:30.910658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:30.918737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e20d6f83-3f8c-452f-8cab-fa14e31de91e tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1515 microversion: 2.1 time: 0.166905 Jul 18 16:44:30.919331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 303/601] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:30 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:31.661577 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:31.662983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:31.670842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.671292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.672082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.672520 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.708412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6e035695-0b17-4d35-b5bd-821437a131d8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051428 Jul 18 16:44:31.709016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 299/602] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:44:31 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:31.784435 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:31.785107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:31.792617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.793011 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.793804 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.794277 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.825748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:44:31.924367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-386454ef-50fa-4095-9773-946019d14740 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 204 len: 0 microversion: 2.20 time: 0.143260 Jul 18 16:44:31.925809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 304/603] 10.222.0.77 () {60 vars in 1279 bytes} [Mon Jul 18 16:44:31 2022] DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 16:44:31.941515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:31.942561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:31.942783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:31.944093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:31.951125 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.952166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.953647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.955017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.955956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.956760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:31.958389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:31.959847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:32.191392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:32.200440 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:32.202002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:32.203282 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-50706dd1-3f27-4d40-b644-8d5a03347d21 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.269518 Jul 18 16:44:32.203869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 305/604] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:31 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:32.250994 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:32.259575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-da3b699a-fde6-40d0-a644-c49b7af3d6b9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1515 microversion: 2.1 time: 0.326237 Jul 18 16:44:32.260186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 300/605] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:31 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:32.525035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-74e03972-0177-43bb-89ec-a8a25661ece0 req-e13ac379-6eb3-4118-bf8b-3afa9fe48ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf052b3c-d411-47f4-b148-ce34d98d2aa3", "name": "network-vif-deleted", "tag": "f8aec84e-0ae0-4a21-ae14-07199258fc70"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:32.533776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-74e03972-0177-43bb-89ec-a8a25661ece0 req-e13ac379-6eb3-4118-bf8b-3afa9fe48ec1 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:32.534227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-74e03972-0177-43bb-89ec-a8a25661ece0 req-e13ac379-6eb3-4118-bf8b-3afa9fe48ec1 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:32.547793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-74e03972-0177-43bb-89ec-a8a25661ece0 req-e13ac379-6eb3-4118-bf8b-3afa9fe48ec1 service nova] Creating event network-vif-deleted:f8aec84e-0ae0-4a21-ae14-07199258fc70 for instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 on hv-cinder-83754 Jul 18 16:44:32.553809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-74e03972-0177-43bb-89ec-a8a25661ece0 req-e13ac379-6eb3-4118-bf8b-3afa9fe48ec1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Jul 18 16:44:32.554485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 306/606] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:33.223566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:33.224318 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:33.232147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:33.232624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:33.233679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:33.234126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:33.283312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:33.284607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:33.293051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:33.293585 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:33.294482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:33.295069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:33.375845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:33.389109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-01b04310-63df-41e3-8f6a-9b091dee4213 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1473 microversion: 2.1 time: 0.114963 Jul 18 16:44:33.390182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 307/607] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:33 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1473 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:33.393177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:33.403109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:33.404867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:33.406250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-18b46abb-4cc4-4468-810e-5c9407c9e9ff tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.186957 Jul 18 16:44:33.407146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 301/608] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:33 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:34.413649 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:34.414351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:34.424021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:34.425397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:34.426932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:34.427932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:34.428545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:34.429511 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:34.437526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:34.438018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:34.438820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:34.439309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:34.470806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:34.471254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:34.471910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lazy-loading 'fault' on Instance uuid cf052b3c-d411-47f4-b148-ce34d98d2aa3 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:34.524710 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:34.540480 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5801c3bb-a29d-42da-abb8-d788b36b7bc8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 200 len: 1309 microversion: 2.1 time: 0.129840 Jul 18 16:44:34.541677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 308/609] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:34 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:34.726173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:34.740139 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:34.742438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:34.743952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-89d2129d-75f0-4375-837c-c3561a2a240b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1724 microversion: 2.20 time: 0.320100 Jul 18 16:44:34.744712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 302/610] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:34 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:35.572074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:35.574761 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: cf052b3c-d411-47f4-b148-ce34d98d2aa3] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:35.580515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-e04ccab1-20c8-45fb-a300-49c95d1f92b8 req-c164ed0f-50f2-4a2b-83e5-b3f49169829a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7", "name": "network-vif-deleted", "tag": "01d252c0-4708-4842-b47f-06feaedb0c39"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:35.590231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.591471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.593174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.599693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.606989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e04ccab1-20c8-45fb-a300-49c95d1f92b8 req-c164ed0f-50f2-4a2b-83e5-b3f49169829a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.609284 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e04ccab1-20c8-45fb-a300-49c95d1f92b8 req-c164ed0f-50f2-4a2b-83e5-b3f49169829a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.624617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-e04ccab1-20c8-45fb-a300-49c95d1f92b8 req-c164ed0f-50f2-4a2b-83e5-b3f49169829a service nova] Creating event network-vif-deleted:01d252c0-4708-4842-b47f-06feaedb0c39 for instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 on hv-cinder-83754 Jul 18 16:44:35.629884 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-e04ccab1-20c8-45fb-a300-49c95d1f92b8 req-c164ed0f-50f2-4a2b-83e5-b3f49169829a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053236 Jul 18 16:44:35.630655 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 303/611] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:35.653599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] HTTP exception thrown: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Request method failure captured: Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 HTTP/1.1 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y2kVtvQJBYLS0b1si059xIF7n1onxcabbDoOcOobRPEHn_vRolBJ8uGvJtIiaB8B7ckYHP7tjGV4j1BHTbA_De7P6bwDuxVX5mu5-bBayC0aE_thtQ9FDKT1aCHIEDZNM_5DfQ_NAmtN8H4sq5AWws6OH9jRq2kp3ToLe159ZqNpLY Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 56792f3625e2457bbe9aa0dfa9763028 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:44:35.656979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_56792f3625e2457bbe9aa0dfa9763028", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 56792f3625e2457bbe9aa0dfa9763028 Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesSnapshotTestJSON-567842884-project Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 5c7220e14fcd40c9a78bbcef1a1db5d9 Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesSnapshotTestJSON-567842884-project Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. Jul 18 16:44:35.658575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': 'cf052b3c-d411-47f4-b148-ce34d98d2aa3'} Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:35.659444 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. Jul 18 16:44:35.660719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:35.661873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Returning 404 to user: Instance cf052b3c-d411-47f4-b148-ce34d98d2aa3 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:35.661873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4ab3de6c-20f5-4d06-bb0c-b9b327a78353 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3" status: 404 len: 111 microversion: 2.1 time: 0.095305 Jul 18 16:44:35.661873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 309/612] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:35 2022] GET /compute/v2.1/servers/cf052b3c-d411-47f4-b148-ce34d98d2aa3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:44:35.764614 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:35.765451 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:35.781722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.782671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.806843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.807879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.893335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:35.894169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:35.895351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lazy-loading 'fault' on Instance uuid 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:35.990215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:36.001101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:36.002747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:36.004083 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a1f688f6-82bd-4f47-9d16-31e7c62d00d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 200 len: 1372 microversion: 2.20 time: 0.244196 Jul 18 16:44:36.004654 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 304/613] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:35 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:37.030905 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:37.031531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:37.038833 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:37.039367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:37.040205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:37.040702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:37.056729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 HTTP/1.1 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:44:37.058580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:44:37.060336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7'} Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:44:37.061466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:44:37.063722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:44:37.066010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:44:37.066010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6d73e61f-d026-44f8-bfaf-4f308ad5e205 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 404 len: 111 microversion: 2.20 time: 0.033372 Jul 18 16:44:37.066010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 310/614] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:37 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:44:37.071923 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2268219d-7cc0-452a-b672-122742a13ad8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '.version_select at 0x7fc3a1edb550>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:37.095189 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2268219d-7cc0-452a-b672-122742a13ad8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095451099" status: 204 len: 0 microversion: 2.20 time: 0.027940 Jul 18 16:44:37.095783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 305/615] 10.222.0.77 () {60 vars in 1261 bytes} [Mon Jul 18 16:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095451099 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 16:44:37.864806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-06173d05-4d32-4514-82c0-bb9b1969889e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: .version_select at 0x7fc3a20dad30>, body: {"keypair": {"name": "tempest-keypair-1987402163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ7QPSOjRPvEOG7kTTiCghGa9JYxqbO3MQqwIytsh3QW/qJNW18rjMAgOL5qqvnFSsatvThFeMhnK5RWQJ7bZCahGHDvxeKsn0Juygg0CCvYniYvDV3HDBOAcIxXfbR7Q=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:37.884606 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-06173d05-4d32-4514-82c0-bb9b1969889e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:44:37.889700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-06173d05-4d32-4514-82c0-bb9b1969889e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for user 4909d4aef302404290adcd3268e53c1b and project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:44:37.915383 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-06173d05-4d32-4514-82c0-bb9b1969889e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055221 Jul 18 16:44:37.916256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 311/616] 10.222.0.77 () {62 vars in 1199 bytes} [Mon Jul 18 16:44:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 16:44:39.487672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1133114591", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fd6b543-38a6-4937-914e-f705a5e37fe0"}], "security_groups": [{"name": "tempest-securitygroup--1527741058"}], "key_name": "tempest-keypair-1987402163", "user_data": "}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:39.612374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] validate_networks() for [('6fd6b543-38a6-4937-914e-f705a5e37fe0', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:44:40.449128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:44:40.449583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:44:40.450058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:44:40.450503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:44:40.450913 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:44:40.460783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:40.461226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:40.463020 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:40.463466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:40.482375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:44:40.487234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Getting quotas for user 4909d4aef302404290adcd3268e53c1b and project 26a41505f0ce4a66a02a5d954da278cb. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:44:40.501189 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:44:40.503598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:44:40.557774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fc6ab948-ddf5-413d-be92-03e0a611bc53 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.074748 Jul 18 16:44:40.558925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 306/617] 10.222.0.77 () {62 vars in 1187 bytes} [Mon Jul 18 16:44:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 16:44:40.576521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:40.577850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:40.664390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:40.677301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:40.681142 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:40.683680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3e58ff1b-a38e-42f6-9b7f-76337179ce9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1282 microversion: 2.20 time: 0.113719 Jul 18 16:44:40.685090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 312/618] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:40 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:41.714063 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:41.714927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:41.722218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:41.722752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:41.723580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:41.724061 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:41.794709 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:41.804815 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:41.806536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:41.807922 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f875f1fa-3c8a-44ef-b4e5-d95a20f599db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1334 microversion: 2.20 time: 0.098404 Jul 18 16:44:41.808667 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 307/619] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:41 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:42.827373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:42.828051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:42.835218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:42.835658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:42.837420 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:42.837420 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:42.906667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:42.917525 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:42.919159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:42.920826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-852fd865-6d4c-4295-ad2d-39c32168d7c0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1334 microversion: 2.20 time: 0.097032 Jul 18 16:44:42.921301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 313/620] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:42 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:43.942615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:43.943236 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:43.951023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:43.951439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:43.952233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:43.952660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:44.042377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:44.056749 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:44.059370 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:44.061516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-eecab5d1-c202-4af1-8dde-f33ba55c79d6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1334 microversion: 2.20 time: 0.123801 Jul 18 16:44:44.062572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 308/621] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:43 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1334 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:45.090827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:45.090827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:45.097457 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:45.098245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:45.099340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:45.099775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:45.184551 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:45.194803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:45.196887 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:45.198242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-45651e88-b2ba-4ce6-905f-ee9bede2a365 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1340 microversion: 2.20 time: 0.112937 Jul 18 16:44:45.198965 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 314/622] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:45 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:46.020420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1160060590", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "networks": [{"uuid": "7f1b0a03-df48-4d24-bcde-649f3975d3a7"}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:46.103518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] validate_networks() for [('7f1b0a03-df48-4d24-bcde-649f3975d3a7', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:44:46.223982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:46.225172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:46.236762 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.237555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.239000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.239821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.467287 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:46.482777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:46.486109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:46.488758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d95d971d-a286-4417-b2bc-1f58006e3e9c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.273081 Jul 18 16:44:46.489694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 315/623] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:46 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:46.621681 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:46.622371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:46.629777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.630230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.631166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.632018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.740680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:46.748167 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'services' on Instance uuid 911b4446-c815-49de-931d-b16a8e398fe1 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:46.855128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1bdae3a8-974e-44f8-ae5d-f4331594f154 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments/88ac62ce-7db1-4370-a328-40d73f459f96" status: 202 len: 0 microversion: 2.1 time: 0.239043 Jul 18 16:44:46.855975 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 316/624] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:44:46 2022] DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments/88ac62ce-7db1-4370-a328-40d73f459f96 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:44:46.866563 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:46.867413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:46.875110 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.875561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.876349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.876783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.917978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:44:46.918399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:44:46.918894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:44:46.919333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:44:46.919741 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:44:46.932016 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b2ccea85-dd00-4071-8612-6a9f7730c0de tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070630 Jul 18 16:44:46.937597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.938267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.938711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 317/625] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:44:46 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:44:46.939820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:46.940643 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:46.967323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Getting quotas for project 56792f3625e2457bbe9aa0dfa9763028. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:44:46.972629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Getting quotas for user 5c7220e14fcd40c9a78bbcef1a1db5d9 and project 56792f3625e2457bbe9aa0dfa9763028. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:44:47.001777 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:44:47.009539 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:44:47.100373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-63db6df6-3a02-4292-bca6-563b0ecdfed9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093560 Jul 18 16:44:47.101890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 309/626] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:44:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:44:47.117616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-73885e37-62b8-42e1-b78f-c06aabf9f9fd tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:47.118781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-73885e37-62b8-42e1-b78f-c06aabf9f9fd tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:47.214674 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-73885e37-62b8-42e1-b78f-c06aabf9f9fd tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:47.232382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-73885e37-62b8-42e1-b78f-c06aabf9f9fd tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1219 microversion: 2.1 time: 0.121867 Jul 18 16:44:47.236048 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 318/627] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:47 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:47.370027 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-14e1c2e3-d044-41b0-9dee-e00269c617a8 req-6ca6fa2c-21b1-4c82-b589-487ea3ac03e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:47.395766 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-14e1c2e3-d044-41b0-9dee-e00269c617a8 req-6ca6fa2c-21b1-4c82-b589-487ea3ac03e1 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:47.396740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-14e1c2e3-d044-41b0-9dee-e00269c617a8 req-6ca6fa2c-21b1-4c82-b589-487ea3ac03e1 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:47.437651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-14e1c2e3-d044-41b0-9dee-e00269c617a8 req-6ca6fa2c-21b1-4c82-b589-487ea3ac03e1 service nova] Creating event network-changed:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:44:47.448730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-14e1c2e3-d044-41b0-9dee-e00269c617a8 req-6ca6fa2c-21b1-4c82-b589-487ea3ac03e1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086824 Jul 18 16:44:47.450546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 310/628] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:44:47.511945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:47.512935 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:47.538033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:47.541804 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:47.543366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:47.544399 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:47.844723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:47.860077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:47.864451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:47.866773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-022dee60-2e72-4f1e-921a-1aefe7397dd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.359112 Jul 18 16:44:47.868671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 319/629] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:47 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:47.945636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:47.946979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:47.957068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:47.957998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:47.959411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:47.960173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:47.993641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:48.022744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b164fec1-b2c7-4030-8e3d-7ba523100412 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081344 Jul 18 16:44:48.023781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 311/630] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:44:47 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:48.255875 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:48.256812 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:48.266911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:48.267762 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:48.269133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:48.269879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:48.380046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:48.388067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d57202df-fea2-45e9-b151-560bcc63b541 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1271 microversion: 2.1 time: 0.137198 Jul 18 16:44:48.388757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 320/631] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:48 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:48.892624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:48.893820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:48.912906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:48.914166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:48.916054 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:48.917010 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.036893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:49.038465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:49.050184 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.052465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.053669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.054370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.115195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0e410153-a975-4d43-9fcb-8b160a23b9b6 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082739 Jul 18 16:44:49.116600 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 321/632] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:44:49 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 16:44:49.248538 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:49.249052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:49.257484 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.259152 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.259539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.261200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.283579 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:49.295496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:49.297218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:49.299105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7bec8285-a2e5-492a-ad51-892d8e8d5450 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.416241 Jul 18 16:44:49.300226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 312/633] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:48 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:49.313226 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:44:49.405578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:49.406211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:49.415988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.416969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.418137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.418943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.465384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0a6028b9-6736-4046-a8dc-490facfa0ec2 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 204 len: 0 microversion: 2.1 time: 0.223479 Jul 18 16:44:49.469214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 322/634] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:44:49 2022] DELETE /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:44:49.475299 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:49.476024 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:49.483414 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.483869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.484806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:49.485261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:49.531007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:49.541560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3fbb9826-6ab6-4e24-8dc2-abcc52841817 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1277 microversion: 2.1 time: 0.139888 Jul 18 16:44:49.542169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 313/635] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:49 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:49.827667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:49.839725 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-298ddc04-31a0-4a70-acaf-6fff84b18824 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1686 microversion: 2.1 time: 0.368840 Jul 18 16:44:49.840322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 323/636] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:49 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1686 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:50.320337 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:50.320947 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:50.328205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.328776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:50.329453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.329881 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:50.489477 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:50.498395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:50.500312 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:50.501473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3e1b4224-e68b-4852-b78f-804883073d14 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.185357 Jul 18 16:44:50.502046 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 314/637] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:50 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:50.562086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:50.562742 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:50.570245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.570813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:50.571554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.572033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:50.753728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:50.763505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-61bb82d8-59f3-4f5a-ad68-02cff15d27cb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.205834 Jul 18 16:44:50.764161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 324/638] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:50 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:50.859225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:50.859755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:50.866678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.867155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:50.868012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:50.868450 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:51.028203 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:51.036911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1e541872-04a6-4d7d-9ea4-a41a9df7f2c5 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1686 microversion: 2.1 time: 0.182200 Jul 18 16:44:51.037694 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 315/639] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:50 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:51.520043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:51.520653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:51.527496 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:51.527943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:51.528742 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:51.529182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:51.724968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:51.734385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:51.735956 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:51.737114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-57206b48-2f6d-4c13-8af0-4257f5a3291c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.221129 Jul 18 16:44:51.737693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 325/640] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:51 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:51.789956 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:51.790747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:51.798622 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:51.799105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:51.799994 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:51.800496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:51.957089 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:51.965470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-052c8300-26b4-478f-abbd-1f6fa8b86ac7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.179991 Jul 18 16:44:51.966128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 316/641] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:51 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:52.063176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:52.063705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:52.072393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:52.073047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:52.073952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:52.074531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:52.252719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:52.262255 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9efae62a-ba49-4202-8f18-cbb691bf9084 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1686 microversion: 2.1 time: 0.203391 Jul 18 16:44:52.262982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 326/642] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:52 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1686 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:52.755027 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:52.755771 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:52.763241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:52.763698 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:52.764497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:52.764934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:52.926040 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:52.936071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:52.937876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:52.939787 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a0c12fcd-a292-476b-9b27-80e115f44484 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.188714 Jul 18 16:44:52.940836 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 317/643] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:52 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:52.983655 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:52.984730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:52.998043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:52.998926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:53.000659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:53.001946 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:53.191458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:53.200601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8d3b6021-bef4-45a2-986b-d9a26b5ba996 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.221022 Jul 18 16:44:53.201258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 327/644] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:52 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:53.288770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:53.290109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:53.298015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:53.298676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:53.299943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:53.300482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:53.457735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:53.466801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-165d7112-f73a-4bc2-9a8b-1bcfb90671a3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1686 microversion: 2.1 time: 0.182606 Jul 18 16:44:53.467405 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 318/645] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:53 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:53.961832 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:53.962474 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:53.968966 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:53.969499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:53.970385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:53.970850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:54.157242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:54.166065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:54.167614 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:54.168771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8f2cf293-d638-4eb5-86e7-85c16cb74735 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.211807 Jul 18 16:44:54.169340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 328/646] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:53 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:54.218131 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:54.218818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:54.225896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:54.226341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:54.227272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:54.227615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:54.381748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:54.390575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-19c92232-f4a5-414d-afd5-4cdc73e9bef8 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.176396 Jul 18 16:44:54.391201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 319/647] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:54 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:54.485610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:54.486220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:54.493701 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:54.494122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:54.494933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:54.495363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:54.761463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:54.771252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dc08fa32-d570-4c98-8185-962156982983 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1686 microversion: 2.1 time: 0.289433 Jul 18 16:44:54.772245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 329/648] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:54 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1686 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:55.193707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:55.196705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:55.212583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.218431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.221895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.222854 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.346992 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-7f285839-f2a4-4f6a-b15a-6e82849f091a req-dcd0cf21-3f37-48f7-91d7-8bb437103466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "name": "network-vif-plugged", "status": "completed", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:55.366834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7f285839-f2a4-4f6a-b15a-6e82849f091a req-dcd0cf21-3f37-48f7-91d7-8bb437103466 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.368983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7f285839-f2a4-4f6a-b15a-6e82849f091a req-dcd0cf21-3f37-48f7-91d7-8bb437103466 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.392067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-7f285839-f2a4-4f6a-b15a-6e82849f091a req-dcd0cf21-3f37-48f7-91d7-8bb437103466 service nova] Creating event network-vif-plugged:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:44:55.402816 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-7f285839-f2a4-4f6a-b15a-6e82849f091a req-dcd0cf21-3f37-48f7-91d7-8bb437103466 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060526 Jul 18 16:44:55.404871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 330/649] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:55.415793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:55.417686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:55.430929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.432152 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.433906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.435058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.720079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:55.738135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:55.742224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:55.746596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-58719a29-5bd2-4f79-b0e8-c56e904cbe08 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.561914 Jul 18 16:44:55.748296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 320/650] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:55 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:55.856275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-d0266f8b-8456-4953-ae02-2909864505d9 req-abb7618c-4504-4ab4-a840-cad12548352d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60dda1c4-b6c2-4da3-a0cd-d14c27edee3b", "tag": "81a62187-a923-4147-96e4-b99a056a802f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:55.871274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-d0266f8b-8456-4953-ae02-2909864505d9 req-abb7618c-4504-4ab4-a840-cad12548352d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.872119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-d0266f8b-8456-4953-ae02-2909864505d9 req-abb7618c-4504-4ab4-a840-cad12548352d service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.888343 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-d0266f8b-8456-4953-ae02-2909864505d9 req-abb7618c-4504-4ab4-a840-cad12548352d service nova] Creating event network-changed:81a62187-a923-4147-96e4-b99a056a802f for instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b on hv-cinder-83754 Jul 18 16:44:55.897365 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-d0266f8b-8456-4953-ae02-2909864505d9 req-abb7618c-4504-4ab4-a840-cad12548352d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146298 Jul 18 16:44:55.899789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 321/651] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:55.910244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:55.911745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:55.923708 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.924515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.925471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:55.925995 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:55.963977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:55.998252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-61eb772e-5536-4973-b2d7-58387455f506 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.589728 Jul 18 16:44:56.000138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 331/652] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:55 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:56.106823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:56.115505 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ca136674-4511-4a0b-99e5-c3996f119815 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1621 microversion: 2.1 time: 0.214050 Jul 18 16:44:56.116208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 322/653] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:55 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1621 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:56.559962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-aeb433c8-9fe1-4dc5-b77e-1ed111bc03cc req-fa263963-5d13-4b01-b8cf-dfed070d6a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b4446-c815-49de-931d-b16a8e398fe1", "name": "network-vif-deleted", "tag": "70811075-cf8a-4301-b4e2-128611842d08"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:44:56.576840 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-aeb433c8-9fe1-4dc5-b77e-1ed111bc03cc req-fa263963-5d13-4b01-b8cf-dfed070d6a92 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:56.577624 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-aeb433c8-9fe1-4dc5-b77e-1ed111bc03cc req-fa263963-5d13-4b01-b8cf-dfed070d6a92 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:56.607370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-aeb433c8-9fe1-4dc5-b77e-1ed111bc03cc req-fa263963-5d13-4b01-b8cf-dfed070d6a92 service nova] Creating event network-vif-deleted:70811075-cf8a-4301-b4e2-128611842d08 for instance 911b4446-c815-49de-931d-b16a8e398fe1 on hv-cinder-83754 Jul 18 16:44:56.614667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-aeb433c8-9fe1-4dc5-b77e-1ed111bc03cc req-fa263963-5d13-4b01-b8cf-dfed070d6a92 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169939 Jul 18 16:44:56.615704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 332/654] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:56.779097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:56.780025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:56.782471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:56.790220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:56.790943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:56.791893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:56.792474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:56.954670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:56.990166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=12 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:57.029526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:57.031741 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:57.044810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:57.050782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:57.052398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:57.054355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:57.055479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:57.108976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:57.110019 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:57.129382 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:57.135140 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:57.137765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7c86526b-ce64-4f69-a9c8-c5b2a925b393 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1408 microversion: 2.20 time: 0.362669 Jul 18 16:44:57.138736 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 323/655] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:56 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:57.145843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:57.146554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:57.160097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:57.161626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:57.163437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:57.167123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:57.230357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=8 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:57.250289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:57.251192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:57.251917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'fault' on Instance uuid 911b4446-c815-49de-931d-b16a8e398fe1 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:57.335810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:57.345250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:57.348022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ffaffe59-02dc-4ae1-8438-d02855fed409 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.328786 Jul 18 16:44:57.349652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 333/656] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:57 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:57.360527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a6d9874d-fda9-4444-8b43-7dc73348659b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1334 microversion: 2.1 time: 0.219549 Jul 18 16:44:57.362543 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 324/657] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:57 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1334 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:58.162275 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:58.163071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:58.171781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.172613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.173540 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.174026 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.376225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:58.376831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:58.384245 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.385247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.386064 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.386605 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.391477 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:58.403333 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:58.405138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:58.406975 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-eae3f781-d7de-44d4-b83d-c73b4ef4732c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1599 microversion: 2.20 time: 0.248850 Jul 18 16:44:58.413032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 334/658] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:44:58 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1599 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:44:58.414455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:58.415526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:58.423623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.424303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.425216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.425880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.474753 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.475616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.477058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'fault' on Instance uuid 911b4446-c815-49de-931d-b16a8e398fe1 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:58.535963 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:58.551209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3643e07-c980-498b-934c-7f411d56e5ad tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1334 microversion: 2.1 time: 0.141362 Jul 18 16:44:58.552239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 335/659] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:58 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1334 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:58.561648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:58.562651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:58.572855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.573401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.574252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:58.574782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:58.598053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:58.622566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-42048847-9b2d-46c4-b1c6-b12b511c4ed6 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.250612 Jul 18 16:44:58.623321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 325/660] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:58 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:58.693223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-df1a4816-f560-425a-b7c1-f7d9922e9113 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139187 Jul 18 16:44:58.693821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 336/661] 10.222.0.77 () {60 vars in 1315 bytes} [Mon Jul 18 16:44:58 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:44:59.583200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:59.584354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:59.613443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.614198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.620476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.621569 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.638828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:59.641334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:59.669129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.670812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.673872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.675028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.740827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.742164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.743177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'fault' on Instance uuid 911b4446-c815-49de-931d-b16a8e398fe1 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:44:59.770712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0baffdc8-3a46-48b0-aba6-416cf95c9941 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/ips" status: 200 len: 149 microversion: 2.1 time: 0.518023 Jul 18 16:44:59.777997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 326/662] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:44:59 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/ips => generated 149 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:59.782005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:59.783256 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:44:59.807374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.808204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.809649 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.810473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.834038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:44:59.866712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6bed9e27-4da1-4f70-b086-26149c406296 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 200 len: 1334 microversion: 2.1 time: 0.299470 Jul 18 16:44:59.868495 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 337/663] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:59 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 1334 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:00.701996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:00.718127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b371739b-572b-40b6-917a-05462741cb0d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.944360 Jul 18 16:45:00.720135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 327/664] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:44:59 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:00.898706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:00.899575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 911b4446-c815-49de-931d-b16a8e398fe1] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:00.906639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:00.907092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:00.907899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:00.908336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:00.925222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] HTTP exception thrown: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Request method failure captured: Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 HTTP/1.1 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy1eX-DjPkyYdfnoJYxaGVNuSu5eYPnaCDDJiLy71EiuUZ5EroXnuvt9Lbnqb_iJPqF6LMIxC35i6j-CjWZ5IeuSN5G7juDyVJl7fFX5mn1dyYmq52fmfXDa_SzJgi3hM7Ut-o955Ff2WciO_ZQOnmk2xLGDuskaOC_u2TuJu_Qq1E Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:45:00.926980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/afb65421f9504a918b7a47451fac6707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_afb65421f9504a918b7a47451fac6707", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: ab3be59ea4c74da3b4e19273102bccd9 Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. Jul 18 16:45:00.929847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '911b4446-c815-49de-931d-b16a8e398fe1'} Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:00.931463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. Jul 18 16:45:00.934247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:00.936482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Returning 404 to user: Instance 911b4446-c815-49de-931d-b16a8e398fe1 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:00.936482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f72b909c-687a-48af-ac3d-84b590d19e53 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1" status: 404 len: 111 microversion: 2.1 time: 0.034432 Jul 18 16:45:00.936482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 338/665] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:00 2022] GET /compute/v2.1/servers/911b4446-c815-49de-931d-b16a8e398fe1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:00.937550 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cfaa29a2-0c1f-454f-9454-6c6591776f8d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '.version_select at 0x7fc3a1dccdc0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:00.966168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cfaa29a2-0c1f-454f-9454-6c6591776f8d tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982414460" status: 202 len: 0 microversion: 2.1 time: 0.032183 Jul 18 16:45:00.967007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 328/666] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 18 16:45:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982414460 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:45:01.112314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-35760ccd-00f4-48b3-8390-19ea57e9c4ba req-71423d03-b756-4a51-876f-0f400851d4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:01.132519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-35760ccd-00f4-48b3-8390-19ea57e9c4ba req-71423d03-b756-4a51-876f-0f400851d4a5 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:01.134046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-35760ccd-00f4-48b3-8390-19ea57e9c4ba req-71423d03-b756-4a51-876f-0f400851d4a5 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:01.160783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-35760ccd-00f4-48b3-8390-19ea57e9c4ba req-71423d03-b756-4a51-876f-0f400851d4a5 service nova] Creating event network-changed:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:45:01.173009 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-35760ccd-00f4-48b3-8390-19ea57e9c4ba req-71423d03-b756-4a51-876f-0f400851d4a5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067374 Jul 18 16:45:01.175402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 339/667] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:01.509190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72a9a643-7194-4ee7-90cc-446f4be2ece9"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:01.511474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:01.535654 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:01.552822 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:01.554880 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:01.555949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:01.720873 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:01.751317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:01.752783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:01.778172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:01.779341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:01.781101 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:01.782230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:02.155660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a58ec68f-dedb-4a7e-96d1-02d8e398c5d0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657587 Jul 18 16:45:02.161082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 329/668] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:45:01 2022] POST /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:02.180543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:02.199225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-07ee40c9-2c84-4478-836b-38ed96f0dd9d tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.456233 Jul 18 16:45:02.207209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 340/669] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:01 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:03.239908 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:03.242518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:03.259521 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:03.260899 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:03.262294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:03.276050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:03.480699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-970324de-2852-482a-9fd4-dd512e3d7dd2 req-0ae8ff2e-1801-47fd-8f13-aadc3b7b9ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60dda1c4-b6c2-4da3-a0cd-d14c27edee3b", "name": "network-vif-plugged", "status": "completed", "tag": "81a62187-a923-4147-96e4-b99a056a802f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:03.495272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-970324de-2852-482a-9fd4-dd512e3d7dd2 req-0ae8ff2e-1801-47fd-8f13-aadc3b7b9ac7 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:03.495778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-970324de-2852-482a-9fd4-dd512e3d7dd2 req-0ae8ff2e-1801-47fd-8f13-aadc3b7b9ac7 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:03.510790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-970324de-2852-482a-9fd4-dd512e3d7dd2 req-0ae8ff2e-1801-47fd-8f13-aadc3b7b9ac7 service nova] Creating event network-vif-plugged:81a62187-a923-4147-96e4-b99a056a802f for instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b on hv-cinder-83754 Jul 18 16:45:03.517589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-970324de-2852-482a-9fd4-dd512e3d7dd2 req-0ae8ff2e-1801-47fd-8f13-aadc3b7b9ac7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270620 Jul 18 16:45:03.518842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 341/670] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:03.557244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:03.571119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-07f7dc85-853d-4659-87b4-c3888bd402c9 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.339481 Jul 18 16:45:03.572185 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 330/671] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:03 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:04.595798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:04.596937 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:04.605694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:04.606295 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:04.607529 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:04.608208 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:04.770954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:04.779326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6fc2e016-e224-488a-83a5-ea7d51d3ad54 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1319 microversion: 2.1 time: 0.190241 Jul 18 16:45:04.780083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 342/672] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:04 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:04.944555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:04.945937 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:04.952941 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:04.953425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:04.954232 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:04.954719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:04.984282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:45:05.088695 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c04b3218-9768-40a2-85be-8ca4d3e0a859 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 204 len: 0 microversion: 2.1 time: 0.148075 Jul 18 16:45:05.089611 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 331/673] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:45:04 2022] DELETE /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:45:05.099869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:05.100605 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:05.108425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:05.108994 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:05.109817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:05.110680 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:05.273947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:05.282582 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b21300c8-ec6c-4365-906c-d178ca9a388a tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1508 microversion: 2.1 time: 0.186773 Jul 18 16:45:05.283211 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 343/674] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:05 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:05.799099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:05.799659 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:05.806740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:05.807184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:05.807987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:05.808488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:05.991166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:05.999488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f5b5c204-2580-422f-94c3-341f118f757b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1508 microversion: 2.1 time: 0.205254 Jul 18 16:45:06.000192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 332/675] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:05 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:06.017629 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7a67dc-d3e1-47e8-a611-7ffbcffc690e", "device": "/dev/sdb"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:06.019619 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:06.028051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:06.028651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:06.029574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:06.030059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:06.301768 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:06.302384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:06.309631 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:06.310085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:06.310948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:06.311379 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:06.473822 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:06.482548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-add85462-4440-43a0-9f5c-17a5c43767fa tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1508 microversion: 2.1 time: 0.184763 Jul 18 16:45:06.483388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 333/676] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:06 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:07.089053 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c82f567b-ddac-4d96-b7d8-d9f0cfcbf9c7 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "POST /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.075434 Jul 18 16:45:07.089693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 344/677] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:45:06 2022] POST /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b/os-volume_attachments => generated 194 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:07.502640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:07.503688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:07.512842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:07.513341 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:07.514137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:07.514660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:07.696213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:07.711735 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-60388172-7758-4781-ad75-a48b69f0521b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1508 microversion: 2.1 time: 0.213037 Jul 18 16:45:07.726494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 334/678] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:07 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:08.083375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-1300fa28-69b4-4482-b72b-4d6e95d30f09 req-79e617f4-2ceb-47e6-896a-16354d99b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd76b7-87e8-4bf3-891e-84558f463c32", "name": "network-vif-deleted", "tag": "8bbd976a-e758-4e52-b7e2-3637c08e0c46"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:08.095140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-1300fa28-69b4-4482-b72b-4d6e95d30f09 req-79e617f4-2ceb-47e6-896a-16354d99b0ed service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:08.096493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-1300fa28-69b4-4482-b72b-4d6e95d30f09 req-79e617f4-2ceb-47e6-896a-16354d99b0ed service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:08.111347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-1300fa28-69b4-4482-b72b-4d6e95d30f09 req-79e617f4-2ceb-47e6-896a-16354d99b0ed service nova] Creating event network-vif-deleted:8bbd976a-e758-4e52-b7e2-3637c08e0c46 for instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 on hv-cinder-83754 Jul 18 16:45:08.117679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-1300fa28-69b4-4482-b72b-4d6e95d30f09 req-79e617f4-2ceb-47e6-896a-16354d99b0ed service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038065 Jul 18 16:45:08.118749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 345/679] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:08.737826 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:08.738912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:08.746587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:08.747288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:08.748195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:08.748869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:08.790678 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:08.791242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:08.791811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'fault' on Instance uuid 0dbd76b7-87e8-4bf3-891e-84558f463c32 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:08.854625 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:08.863797 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c51ddc1e-26d9-4c81-84fa-82fcd11367c1 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 200 len: 1312 microversion: 2.1 time: 0.132157 Jul 18 16:45:08.864567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 335/680] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:08 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 1312 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:09.888159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:09.889415 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 0dbd76b7-87e8-4bf3-891e-84558f463c32] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:09.900490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.901621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:09.902609 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.903352 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:09.924219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] HTTP exception thrown: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Request method failure captured: Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 HTTP/1.1 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy1eX-DjPkyYdfnoJYxaGVNuSu5eYPnaCDDJiLy71EiuUZ5EroXnuvt9Lbnqb_iJPqF6LMIxC35i6j-CjWZ5IeuSN5G7juDyVJl7fFX5mn1dyYmq52fmfXDa_SzJgi3hM7Ut-o955Ff2WciO_ZQOnmk2xLGDuskaOC_u2TuJu_Qq1E Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:45:09.926692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/afb65421f9504a918b7a47451fac6707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_afb65421f9504a918b7a47451fac6707", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: ab3be59ea4c74da3b4e19273102bccd9 Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. Jul 18 16:45:09.929696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '0dbd76b7-87e8-4bf3-891e-84558f463c32'} Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:09.931736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. Jul 18 16:45:09.934139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:09.936510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Returning 404 to user: Instance 0dbd76b7-87e8-4bf3-891e-84558f463c32 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:09.936510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f3dbbbda-5eb8-472a-ab15-59c0172150fb tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32" status: 404 len: 111 microversion: 2.1 time: 0.050196 Jul 18 16:45:09.936510 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 346/681] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:09 2022] GET /compute/v2.1/servers/0dbd76b7-87e8-4bf3-891e-84558f463c32 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:09.942687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:09.943819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:09.951837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72a9a643-7194-4ee7-90cc-446f4be2ece9"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:09.953246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:09.953909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.954593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:09.956043 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.956781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:09.960939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.961611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:09.963878 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:09.964530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.004878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:45:10.111247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6de60a23-23af-428b-8f3e-6a52b54b48f0 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 204 len: 0 microversion: 2.1 time: 0.175097 Jul 18 16:45:10.111789 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 Jul 18 16:45:10.112240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 336/682] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:45:09 2022] DELETE /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: POST /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments HTTP/1.1 Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 74 Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:45:10.118059 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {"volumeAttachment": {"volumeId": "72a9a643-7194-4ee7-90cc-446f4be2ece9"}} Jul 18 16:45:10.119844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'server_id': '2041fced-2b7e-4c58-998e-a14e43cd2707', 'body': {'volumeAttachment': {'volumeId': '72a9a643-7194-4ee7-90cc-446f4be2ece9'}}} Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:10.120801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:10.122007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:10.123562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:10.123562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:10.123562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:10.123562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 Jul 18 16:45:10.123562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:10.123954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:10.123954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:10.124971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 400 to user: Invalid volume: volume 72a9a643-7194-4ee7-90cc-446f4be2ece9 is already attached to instances: 2041fced-2b7e-4c58-998e-a14e43cd2707 {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:10.126139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a27c1f92-740b-47f2-b810-3c43dacac2e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178505 Jul 18 16:45:10.126905 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 347/683] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:45:09 2022] POST /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:45:10.132289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.132289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.132289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.132289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.250016 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:10.251507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:10.263620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.264827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.266377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.267303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.306279 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:10.320321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b60da152-23fd-4887-9da9-91a50d4663d3 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.202424 Jul 18 16:45:10.321428 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 337/684] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:10 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:10.392398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'services' on Instance uuid 2041fced-2b7e-4c58-998e-a14e43cd2707 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:10.493968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b68cbc1a-f9f2-49b5-97a7-d607923ac90c tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments/72a9a643-7194-4ee7-90cc-446f4be2ece9" status: 202 len: 0 microversion: 2.1 time: 0.250974 Jul 18 16:45:10.494734 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 348/685] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:45:10 2022] DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments/72a9a643-7194-4ee7-90cc-446f4be2ece9 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:45:10.504214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:10.505547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:10.512917 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.513473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.514288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:10.514743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:10.551439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0041e036-2b3f-4d61-9404-e013f509064a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051575 Jul 18 16:45:10.552381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 338/686] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:10 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:11.342224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:11.343013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:11.350098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:11.350599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:11.352076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:11.352707 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:11.515362 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:11.528267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d2d77c51-1256-4cfe-b2e8-43e7302d1c88 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.190432 Jul 18 16:45:11.529245 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 349/687] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:11 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:11.564940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:11.565898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:11.573377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:11.573830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:11.574668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:11.575106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:11.611290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9d35898e-a3ee-4678-9199-ca9b37878d8b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050421 Jul 18 16:45:11.611792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 339/688] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:11 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:12.556393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:12.557476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:12.570232 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:12.570948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:12.572364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:12.572970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:12.627151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:12.628239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:12.641238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:12.641948 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:12.644031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:12.644800 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:12.712443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c36ee37b-1f9f-4f99-925e-4e38aa554918 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089208 Jul 18 16:45:12.718272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 340/689] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:12 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:12.761702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:12.771242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c0a7b371-d2a1-46f8-9525-2a10e034c10b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1521 microversion: 2.1 time: 0.221913 Jul 18 16:45:12.771767 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 350/690] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:12 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:13.645096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-c2d35bcb-7b62-4b5f-9190-a2e9734db348 req-9e5d0748-6cd7-4a94-b138-dd3002d2abe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5818de22-86dc-4174-86ff-b7e7d2873b35", "name": "network-vif-deleted", "tag": "2c938ddc-cf79-46fa-8c47-ae2bce6cd76b"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:13.667008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-c2d35bcb-7b62-4b5f-9190-a2e9734db348 req-9e5d0748-6cd7-4a94-b138-dd3002d2abe2 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.667757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-c2d35bcb-7b62-4b5f-9190-a2e9734db348 req-9e5d0748-6cd7-4a94-b138-dd3002d2abe2 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.691902 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-c2d35bcb-7b62-4b5f-9190-a2e9734db348 req-9e5d0748-6cd7-4a94-b138-dd3002d2abe2 service nova] Creating event network-vif-deleted:2c938ddc-cf79-46fa-8c47-ae2bce6cd76b for instance 5818de22-86dc-4174-86ff-b7e7d2873b35 on hv-cinder-83754 Jul 18 16:45:13.699761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-c2d35bcb-7b62-4b5f-9190-a2e9734db348 req-9e5d0748-6cd7-4a94-b138-dd3002d2abe2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062623 Jul 18 16:45:13.700856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 341/691] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:13.730907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:13.732814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:13.744482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.744959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.746552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.746552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.751357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:13.790871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-16222677-c762-498b-afee-e806ca5c423e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061677 Jul 18 16:45:13.792422 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 351/692] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:13 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:13.793357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:13.794264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:13.801853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.802288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.803097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.803526 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.808363 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:13.842911 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:13.843354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:13.843808 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lazy-loading 'fault' on Instance uuid 5818de22-86dc-4174-86ff-b7e7d2873b35 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:13.899556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3be59ea4c74da3b4e19273102bccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb65421f9504a918b7a47451fac6707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:13.914449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dd09064e-38dd-4e67-b32e-ce45a6721548 tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 200 len: 1311 microversion: 2.1 time: 0.126626 Jul 18 16:45:13.915556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 342/693] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:13 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:14.807238 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:14.808520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:14.816172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:14.816796 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:14.817635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:14.818137 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:14.855479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b94a4741-200a-42ed-9310-6fe86cdc74be tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053489 Jul 18 16:45:14.856103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 352/694] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:14 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:14.933626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:14.934290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] [instance: 5818de22-86dc-4174-86ff-b7e7d2873b35] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:14.942431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:14.943190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:14.945137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:14.945831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:14.961701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] HTTP exception thrown: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Request method failure captured: Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 HTTP/1.1 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy1eX-DjPkyYdfnoJYxaGVNuSu5eYPnaCDDJiLy71EiuUZ5EroXnuvt9Lbnqb_iJPqF6LMIxC35i6j-CjWZ5IeuSN5G7juDyVJl7fFX5mn1dyYmq52fmfXDa_SzJgi3hM7Ut-o955Ff2WciO_ZQOnmk2xLGDuskaOC_u2TuJu_Qq1E Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:45:14.963426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/afb65421f9504a918b7a47451fac6707"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_afb65421f9504a918b7a47451fac6707", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/afb65421f9504a918b7a47451fac6707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: afb65421f9504a918b7a47451fac6707 Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1849534022 Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: ab3be59ea4c74da3b4e19273102bccd9 Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1849534022-project Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. Jul 18 16:45:14.966099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '5818de22-86dc-4174-86ff-b7e7d2873b35'} Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:14.967817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. Jul 18 16:45:14.970348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:14.972419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] Returning 404 to user: Instance 5818de22-86dc-4174-86ff-b7e7d2873b35 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:14.972419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-003594c1-6816-48eb-b0d9-85cd2a30089b tempest-ServerRescueNegativeTestJSON-1849534022 tempest-ServerRescueNegativeTestJSON-1849534022-project] 10.222.0.77 "GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35" status: 404 len: 111 microversion: 2.1 time: 0.035826 Jul 18 16:45:14.972419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 343/695] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:14 2022] GET /compute/v2.1/servers/5818de22-86dc-4174-86ff-b7e7d2873b35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:15.868452 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:15.869712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:15.877639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:15.878214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:15.879129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:15.879718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:15.920932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1fe00e12-be56-40ae-b5b4-14ba23af48c6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057161 Jul 18 16:45:15.921663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 353/696] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:15 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:16.936622 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:16.938241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:16.947115 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:16.947462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:16.948713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:16.949126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:17.010705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bfe1188e-95ea-434e-817e-37029fbb3737 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077518 Jul 18 16:45:17.011840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 344/697] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:16 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:18.032286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:18.042487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:18.053126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:18.054391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:18.055695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:18.056443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:18.110564 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1d434714-2756-49d9-99c0-4a1d28a100e1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086644 Jul 18 16:45:18.111452 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 354/698] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:18 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:19.132193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:19.135033 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:19.180512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:19.180512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:19.180512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:19.180512 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:19.264030 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bdffa4f8-7b13-4bb6-8d82-a1db58b3403b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139664 Jul 18 16:45:19.271255 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 345/699] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:19 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:20.279794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:20.280781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:20.290342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:20.291003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:20.292314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:20.293096 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:20.348920 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d0002b53-5c0b-46b1-aa9f-4d17647a7b54 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072903 Jul 18 16:45:20.350060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 355/700] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:20 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:21.364975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:21.367419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:21.378964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:21.379723 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:21.381132 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:21.382498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:21.441071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b7e6b528-41d1-4ae1-93b8-33b950c159c3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083619 Jul 18 16:45:21.442038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 346/701] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:21 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:22.456284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:22.457669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:22.466132 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:22.467034 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:22.468192 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:22.468803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:22.508713 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-21306c70-6d53-465d-a623-79ae8519e89e tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056614 Jul 18 16:45:22.509305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 356/702] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:22 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:23.524600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:23.526077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:23.539462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:23.540195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:23.541622 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:23.542463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:23.587348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bcfefe4a-f880-46db-840a-ed87b3befe02 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069663 Jul 18 16:45:23.596443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 347/703] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:45:23 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:45:23.709331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:23.711679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:23.725913 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:23.727097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:23.728868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:23.729927 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:23.783408 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:45:24.063508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ed60183b-3bfa-46a8-8c93-f7ca39cbdcfd tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 204 len: 0 microversion: 2.1 time: 0.359745 Jul 18 16:45:24.067403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 357/704] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:45:23 2022] DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:45:24.090546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:24.097675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:24.114630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:24.116419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:24.118263 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:24.119395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:24.411630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:24.421213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-042b475f-b4c9-4c21-b51c-748d6384c77b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1681 microversion: 2.1 time: 0.346407 Jul 18 16:45:24.432198 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 348/705] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:24 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1681 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:25.442028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:25.442911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:25.451412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:25.452172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:25.453818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:25.454499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:25.784877 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:25.803039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-692402b4-666f-42c9-b519-03c6e7452924 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1681 microversion: 2.1 time: 0.364971 Jul 18 16:45:25.805323 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 358/706] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:25 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:26.829511 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:26.831011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:26.843590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:26.844606 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:26.846160 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:26.847172 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:27.119056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:27.126110 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c05eaadf-b37e-440d-b22b-132a0a1aa258 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1681 microversion: 2.1 time: 0.304111 Jul 18 16:45:27.128277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 349/707] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:26 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:27.463727 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bcb0d05c-977a-4d19-80e7-f3b53c7e7175 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: .version_select at 0x7fc3a1f2ac10>, body: {"keypair": {"name": "tempest-keypair-901129643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZO7pKirtWzAN3fuK0viD1Fsc0Jk1BiXqjbxqrNRPtL1bf5T/l2HPXvx+hbLMEA8KW9XwpBZWbjYEXFg/WSaYgRFJumgk7BqGminUsrxeFZfREsjB+mmXjDDGg8hFfpTA=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:27.469248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:27.483843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-bcb0d05c-977a-4d19-80e7-f3b53c7e7175 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for project 628c00a1a5df481982b083fa3c447be2. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:45:27.488717 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-bcb0d05c-977a-4d19-80e7-f3b53c7e7175 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for user d66dde93e0f14ce799c9c6294f216781 and project 628c00a1a5df481982b083fa3c447be2. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:45:27.518340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bcb0d05c-977a-4d19-80e7-f3b53c7e7175 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209862 Jul 18 16:45:27.518923 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 359/708] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:45:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:28.159086 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:28.163614 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:28.179020 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:28.186749 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:28.187657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:28.188681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:28.189399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:28.527328 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:28.536675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-58f76ecb-dbb2-49c6-85d3-e1ef750abbad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1681 microversion: 2.1 time: 0.387945 Jul 18 16:45:28.547958 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 350/709] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:28 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:29.565122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:29.571307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:29.607871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:29.608747 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:29.610192 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:29.611109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:29.847617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-433f0d32-800d-4b05-afc2-3433a152d641 req-6cfa5392-05cb-43da-9c12-4400a5e12815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2041fced-2b7e-4c58-998e-a14e43cd2707", "name": "network-vif-deleted", "tag": "f048385e-e6ad-453d-9a07-98ed65178acc"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:29.851409 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:29.872126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1d52f3e6-ea16-44d8-8fe9-52160f8d0491 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 200 len: 1613 microversion: 2.1 time: 0.319389 Jul 18 16:45:29.875121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-433f0d32-800d-4b05-afc2-3433a152d641 req-6cfa5392-05cb-43da-9c12-4400a5e12815 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:29.875707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-433f0d32-800d-4b05-afc2-3433a152d641 req-6cfa5392-05cb-43da-9c12-4400a5e12815 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:29.880637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 360/710] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:29 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 1613 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:29.905869 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-433f0d32-800d-4b05-afc2-3433a152d641 req-6cfa5392-05cb-43da-9c12-4400a5e12815 service nova] Creating event network-vif-deleted:f048385e-e6ad-453d-9a07-98ed65178acc for instance 2041fced-2b7e-4c58-998e-a14e43cd2707 on hv-cinder-83754 Jul 18 16:45:29.916150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-433f0d32-800d-4b05-afc2-3433a152d641 req-6cfa5392-05cb-43da-9c12-4400a5e12815 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074450 Jul 18 16:45:29.918687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 351/711] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:30.516797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-202759915", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98c424f3-63a6-4074-a1da-b047ae66c92b"}], "security_groups": [{"name": "tempest-securitygroup--339493468"}], "key_name": "tempest-keypair-901129643", "user_data": "}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:30.697728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] validate_networks() for [('98c424f3-63a6-4074-a1da-b047ae66c92b', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:45:30.898576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:30.899309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:30.912725 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:30.913486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:30.915643 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:30.916085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:30.958090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 HTTP/1.1 Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:45:30.959932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:45:30.963163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '2041fced-2b7e-4c58-998e-a14e43cd2707'} Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:30.964874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:45:30.967167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:45:30.972335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:30.972335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-73f971f8-2361-4358-bd8c-d657ef400e74 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 404 len: 111 microversion: 2.1 time: 0.067296 Jul 18 16:45:30.972335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 352/712] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:30 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:30.978816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-33b6e141-8b16-4c4f-8ae5-55bb7d5f078b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '.version_select at 0x7fc3a1e2c700>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:31.002259 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-33b6e141-8b16-4c4f-8ae5-55bb7d5f078b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361800702" status: 202 len: 0 microversion: 2.1 time: 0.031688 Jul 18 16:45:31.003618 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 353/713] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 18 16:45:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361800702 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:45:31.806372 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:45:31.807420 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:45:31.807635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:45:31.808273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:45:31.808739 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:45:31.825959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:31.832071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:31.833396 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:31.834049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:31.866814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for project 628c00a1a5df481982b083fa3c447be2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:45:31.872070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for user d66dde93e0f14ce799c9c6294f216781 and project 628c00a1a5df481982b083fa3c447be2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:45:31.886190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:45:31.889463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:45:31.968809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-74e122e6-1cb1-4208-9572-fe90c8214fc0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.461976 Jul 18 16:45:31.969526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 361/714] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:45:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:45:31.985466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-47d9e17e-b698-4c2a-9c9d-1a16bb59b60d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:31.992376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-47d9e17e-b698-4c2a-9c9d-1a16bb59b60d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:32.141597 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:32.142109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:32.151442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-47d9e17e-b698-4c2a-9c9d-1a16bb59b60d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:32.166551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-47d9e17e-b698-4c2a-9c9d-1a16bb59b60d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1236 microversion: 2.1 time: 0.186166 Jul 18 16:45:32.167264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 354/715] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:31 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1236 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:32.169244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:32.169711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:32.170596 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:32.173673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:32.354333 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lazy-loading 'services' on Instance uuid 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:32.594361 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-38571c53-2a7a-48f3-848c-5d63a4c1c657 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "DELETE /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b/os-volume_attachments/5b7a67dc-d3e1-47e8-a611-7ffbcffc690e" status: 202 len: 0 microversion: 2.1 time: 0.457532 Jul 18 16:45:32.599179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 362/716] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:45:32 2022] DELETE /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b/os-volume_attachments/5b7a67dc-d3e1-47e8-a611-7ffbcffc690e => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:45:32.611523 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b081266f-3eee-439a-abba-e34469dedfcf tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: .version_select at 0x7fc3a1f1db80>, body: {"keypair": {"name": "tempest-keypair-834522683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXUCip1l0HI5dQBryB7FaKAkvltp+cfHQcjXzxpUimmwifWGr4klRtbBn5KBDhyQ1HNkNVlumDKHBelhMlcAj+8XsqU3FvHZ0aJK86o7rblj6KCLP9Z7kjer9C6YgmRHA=="}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:32.654181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-b081266f-3eee-439a-abba-e34469dedfcf tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:45:32.665406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-b081266f-3eee-439a-abba-e34469dedfcf tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:45:32.743152 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b081266f-3eee-439a-abba-e34469dedfcf tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142497 Jul 18 16:45:32.744774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 355/717] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:45:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:33.186976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:33.187879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:33.197813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:33.198497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:33.199821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:33.200610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:33.337522 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:33.351400 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-566d60bf-1d04-431a-80a9-83b00cb8fa74 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1240 microversion: 2.1 time: 0.168829 Jul 18 16:45:33.352780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 363/718] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:33 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:33.820816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:33.821471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:33.828576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:33.829038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:33.829858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:33.830289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:33.871209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:45:34.045049 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4b153919-1557-494e-b1cf-41c7782c9c93 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "DELETE /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 204 len: 0 microversion: 2.1 time: 0.227701 Jul 18 16:45:34.045907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 356/719] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:45:33 2022] DELETE /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:45:34.061111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:34.062193 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:34.074766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:34.076473 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:34.078179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:34.079324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:34.322826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:34.338598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6859beda-80b9-48dc-a2c8-39e19f69b774 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1514 microversion: 2.1 time: 0.286216 Jul 18 16:45:34.348317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 364/720] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:34 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:34.371182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:34.372791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:34.386756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:34.387831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:34.389110 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:34.390449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:34.462498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:34.472949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-44bf0864-24f4-45ea-91b6-5be052e11a07 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1296 microversion: 2.1 time: 0.106733 Jul 18 16:45:34.474012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 357/721] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:34 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:34.727835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1462081856", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "509e7a9e-2f1a-47ea-a4fb-2e64a591cc67"}], "security_groups": [{"name": "tempest-securitygroup--659973078"}], "key_name": "tempest-keypair-834522683", "user_data": "}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:34.837824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] validate_networks() for [('509e7a9e-2f1a-47ea-a4fb-2e64a591cc67', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:45:35.241726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:45:35.242140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:45:35.242638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:45:35.243035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:45:35.243440 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:45:35.252843 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.253276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.254062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.254528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.271371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:45:35.275398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Getting quotas for user 8bd1061f505d4249ae14c7cbf68a950a and project dbd9c6bf5b0c491299815d545c1a594e. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:45:35.286506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:45:35.289338 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:45:35.338181 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c3d69a6e-61f1-4224-86d1-76f307af3242 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615069 Jul 18 16:45:35.339430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 365/722] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:45:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:45:35.353198 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6aae7a81-0336-4dcf-8cb8-46617915c44f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:35.354539 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6aae7a81-0336-4dcf-8cb8-46617915c44f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:35.356882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:35.357501 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:35.364814 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.365488 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.366798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.367256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.445327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6aae7a81-0336-4dcf-8cb8-46617915c44f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:35.454839 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6aae7a81-0336-4dcf-8cb8-46617915c44f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1241 microversion: 2.1 time: 0.109181 Jul 18 16:45:35.457455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 358/723] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:35 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:35.491617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:35.492656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:35.509121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.509931 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.511333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:35.512321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:35.546896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:35.557139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-82a2c496-ea0d-453b-bc93-b5d75c6a7abb tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1514 microversion: 2.1 time: 0.204268 Jul 18 16:45:35.557960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 366/724] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:35 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:35.623073 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:35.637267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6a909b28-dab7-4613-ba21-acd97ad93bb1 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1296 microversion: 2.1 time: 0.149352 Jul 18 16:45:35.638473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 359/725] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:35 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1296 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:36.475468 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:36.476224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:36.483696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.484237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.485118 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.485636 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.581570 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:36.586633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:36.594286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.595000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.595906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.596608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.637180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:36.641620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:36.646777 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5736a097-d3df-4e1a-84fc-20b315cda5a0 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1293 microversion: 2.1 time: 0.175808 Jul 18 16:45:36.648160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 367/726] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:36 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:36.665821 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:36.667144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:36.681012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.682122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.683857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:36.684704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:36.855785 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:36.870768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-71c8f575-962e-441b-a267-cf0637b9796b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1294 microversion: 2.1 time: 0.212734 Jul 18 16:45:36.882162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 368/727] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:36 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:36.884290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:36.899338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-18685109-6718-4ba6-aba0-7e867f608cc3 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1514 microversion: 2.1 time: 0.321770 Jul 18 16:45:36.900416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 360/728] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:36 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:37.220977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-cc507edc-42d6-4956-83d8-cecd9bc7dd79 req-d0c1969f-aaf4-48f5-926c-ec020ebae7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60dda1c4-b6c2-4da3-a0cd-d14c27edee3b", "name": "network-vif-deleted", "tag": "81a62187-a923-4147-96e4-b99a056a802f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:37.248123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-cc507edc-42d6-4956-83d8-cecd9bc7dd79 req-d0c1969f-aaf4-48f5-926c-ec020ebae7f4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.248994 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-cc507edc-42d6-4956-83d8-cecd9bc7dd79 req-d0c1969f-aaf4-48f5-926c-ec020ebae7f4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.275161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-cc507edc-42d6-4956-83d8-cecd9bc7dd79 req-d0c1969f-aaf4-48f5-926c-ec020ebae7f4 service nova] Creating event network-vif-deleted:81a62187-a923-4147-96e4-b99a056a802f for instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b on hv-cinder-83754 Jul 18 16:45:37.284563 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-cc507edc-42d6-4956-83d8-cecd9bc7dd79 req-d0c1969f-aaf4-48f5-926c-ec020ebae7f4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067954 Jul 18 16:45:37.286173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 369/729] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:37.670016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:37.670850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:37.678525 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.679071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.679953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.680492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.759152 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:37.774545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7cb5cbd7-17c5-4ea4-b12c-3f47307d46b9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1299 microversion: 2.1 time: 0.108411 Jul 18 16:45:37.775819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 361/730] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:37 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:37.896209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:37.899184 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:37.911379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.911896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.913985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.914830 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.927630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:37.928927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:37.942607 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.943857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:37.945344 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:37.946625 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:38.004999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:38.006795 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:38.007848 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lazy-loading 'fault' on Instance uuid 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:38.014206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:38.090922 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7220e14fcd40c9a78bbcef1a1db5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56792f3625e2457bbe9aa0dfa9763028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:38.110084 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c2f98e3b-3a1a-42be-bfde-5d6137e0a690 tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 200 len: 1309 microversion: 2.1 time: 0.189382 Jul 18 16:45:38.111412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 362/731] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:37 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:38.584369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:38.607321 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6b88e49a-aca5-4fe8-8fea-2e1bc5601e0d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.719957 Jul 18 16:45:38.608714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 370/732] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:37 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:38.795167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:38.796196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:38.808359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:38.809544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:38.810835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:38.811816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:38.912907 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:38.929177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-93613a7d-57cc-4ed4-b88e-5e3d3d4857f1 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1299 microversion: 2.1 time: 0.137794 Jul 18 16:45:38.931196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 363/733] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:38 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:39.138504 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:39.139249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] [instance: 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:39.146366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.147586 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.148403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.148833 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.169423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] HTTP exception thrown: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Request method failure captured: Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b HTTP/1.1 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y2kVtvQJBYLS0b1si059xIF7n1onxcabbDoOcOobRPEHn_vRolBJ8uGvJtIiaB8B7ckYHP7tjGV4j1BHTbA_De7P6bwDuxVX5mu5-bBayC0aE_thtQ9FDKT1aCHIEDZNM_5DfQ_NAmtN8H4sq5AWws6OH9jRq2kp3ToLe159ZqNpLY Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 56792f3625e2457bbe9aa0dfa9763028 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:45:39.171574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_56792f3625e2457bbe9aa0dfa9763028", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/56792f3625e2457bbe9aa0dfa9763028"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 56792f3625e2457bbe9aa0dfa9763028 Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-567842884 Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesSnapshotTestJSON-567842884-project Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 5c7220e14fcd40c9a78bbcef1a1db5d9 Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesSnapshotTestJSON-567842884-project Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. Jul 18 16:45:39.174294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '60dda1c4-b6c2-4da3-a0cd-d14c27edee3b'} Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:39.175809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. Jul 18 16:45:39.178260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:45:39.184375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] Returning 404 to user: Instance 60dda1c4-b6c2-4da3-a0cd-d14c27edee3b could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:39.184375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-65da1b16-e8eb-422c-be74-27546cc4d86b tempest-VolumesSnapshotTestJSON-567842884 tempest-VolumesSnapshotTestJSON-567842884-project] 10.222.0.77 "GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b" status: 404 len: 111 microversion: 2.1 time: 0.040356 Jul 18 16:45:39.184375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 371/734] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:39 2022] GET /compute/v2.1/servers/60dda1c4-b6c2-4da3-a0cd-d14c27edee3b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:45:39.255935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-05915117-17b6-490e-ae2c-bb8dc9dba5d6 req-c2aab230-3e70-47d3-932b-2e70ec0e1668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb2c5ba-19c9-4812-9da4-a074d69d56f4", "tag": "dd9ce4d7-eac9-49bf-a75b-895d5cdce0df"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:39.283748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-05915117-17b6-490e-ae2c-bb8dc9dba5d6 req-c2aab230-3e70-47d3-932b-2e70ec0e1668 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.284852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-05915117-17b6-490e-ae2c-bb8dc9dba5d6 req-c2aab230-3e70-47d3-932b-2e70ec0e1668 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.340851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-05915117-17b6-490e-ae2c-bb8dc9dba5d6 req-c2aab230-3e70-47d3-932b-2e70ec0e1668 service nova] Creating event network-changed:dd9ce4d7-eac9-49bf-a75b-895d5cdce0df for instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 on hv-cinder-83754 Jul 18 16:45:39.352823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-05915117-17b6-490e-ae2c-bb8dc9dba5d6 req-c2aab230-3e70-47d3-932b-2e70ec0e1668 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107235 Jul 18 16:45:39.355494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 364/735] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:39.629898 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:39.631528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:39.639091 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.639558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.646518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.646518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.955088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:39.958246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:39.966026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.966584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:39.967384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:39.967821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:40.046036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:40.060356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5f22eaa0-f832-4245-9d62-b4ade99ff34a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.434253 Jul 18 16:45:40.062334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 372/736] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:39 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:40.132518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:40.141506 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-eecab4b5-8c12-4639-bb43-84cc0ef6670d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.195886 Jul 18 16:45:40.142440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 365/737] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:39 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:41.079330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:41.080238 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:41.088190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:41.088773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:41.089568 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:41.090038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:41.162387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:41.163416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:41.171151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:41.172125 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:41.173456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:41.173891 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:41.341825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:41.352361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-61d12355-439d-46a1-85d4-acdc62496c41 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.195063 Jul 18 16:45:41.353173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 366/738] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:41 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:41.369098 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:41.377893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0b14ba34-a7a9-4beb-8377-fa304fa0c3ae tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.302539 Jul 18 16:45:41.378618 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 373/739] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:41 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:41.407889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-51ca40f6-cee2-4236-8ef3-ec19ba254620 req-769015e8-d39e-44f3-a7a7-02dc149713b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c987f41-b103-4e2c-b6e6-4ae1ce4e241c", "tag": "9aae68b8-0df8-486e-a0d5-0405e1d676fb"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:41.416725 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-51ca40f6-cee2-4236-8ef3-ec19ba254620 req-769015e8-d39e-44f3-a7a7-02dc149713b3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:41.417165 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-51ca40f6-cee2-4236-8ef3-ec19ba254620 req-769015e8-d39e-44f3-a7a7-02dc149713b3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:41.430850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-51ca40f6-cee2-4236-8ef3-ec19ba254620 req-769015e8-d39e-44f3-a7a7-02dc149713b3 service nova] Creating event network-changed:9aae68b8-0df8-486e-a0d5-0405e1d676fb for instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c on hv-cinder-83754 Jul 18 16:45:41.436471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-51ca40f6-cee2-4236-8ef3-ec19ba254620 req-769015e8-d39e-44f3-a7a7-02dc149713b3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Jul 18 16:45:41.437308 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 367/740] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:42.377979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:42.378646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:42.386046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:42.386534 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:42.387353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:42.387794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:42.398045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:42.399029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:42.406921 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:42.407397 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:42.408289 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:42.408654 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:42.561232 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:42.569439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9bb7a9d2-d04f-41f7-bdce-c769ab67f60f tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.195291 Jul 18 16:45:42.570031 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 374/741] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:42 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:42.581074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:42.589760 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0ea11fbd-b7b8-4899-af32-51cb645c91ab tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.196821 Jul 18 16:45:42.590353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 368/742] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:42 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:43.587574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:43.588253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:43.595394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:43.595837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:43.596612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:43.597039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:43.617699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:43.618839 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:43.630331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:43.631281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:43.632647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:43.633174 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:43.776433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:43.785491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f78cc025-458c-416e-80c9-2a73d5083edc tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.201852 Jul 18 16:45:43.786279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 375/743] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:43 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:43.791159 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:43.800727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-519ed984-49c2-4433-b2e5-f496ec16b0c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.190478 Jul 18 16:45:43.801315 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 369/744] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:43 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:44.804238 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:44.804939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:44.811852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:44.812279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:44.813074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:44.814170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:44.818012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:44.819747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:44.829484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:44.830157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:44.831360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:44.832120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:44.982949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:44.991108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:44.993445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3bff29aa-4308-46fc-a701-4674da4365eb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.179225 Jul 18 16:45:44.993445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 370/745] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:44 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:44.999869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-acccd3c3-cbfc-4eec-9377-76e851c9abad tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.199823 Jul 18 16:45:45.000461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 376/746] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:44 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:45.602455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:45.603106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:45.605170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=8 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:45.612031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:45.612544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:45.613561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:45.614093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:45.656516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c945743b-5910-4919-a632-8989818b84d2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/ips" status: 200 len: 151 microversion: 2.20 time: 0.056650 Jul 18 16:45:45.656516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 371/747] 10.222.0.77 () {60 vars in 1288 bytes} [Mon Jul 18 16:45:45 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:45:46.015760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:46.019603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:46.029002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:46.031892 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=16 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:46.038842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:46.039699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:46.056723 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:46.057201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:46.064244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:46.064778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:46.069001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:46.070835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:46.073485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:46.076995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:46.379399 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:46.394899 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8ec61d20-9f7f-4020-a1b1-2dcc9cf4e263 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.372064 Jul 18 16:45:46.395927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 372/748] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:46 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:46.416514 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-f717911c-f82d-4678-92d1-05a82a0788b5 req-5d32fa44-83cf-411a-a989-e8b2c69cd2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb2c5ba-19c9-4812-9da4-a074d69d56f4", "name": "network-vif-plugged", "status": "completed", "tag": "dd9ce4d7-eac9-49bf-a75b-895d5cdce0df"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:46.429719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-f717911c-f82d-4678-92d1-05a82a0788b5 req-5d32fa44-83cf-411a-a989-e8b2c69cd2fa service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:46.430846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-f717911c-f82d-4678-92d1-05a82a0788b5 req-5d32fa44-83cf-411a-a989-e8b2c69cd2fa service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:46.454218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-f717911c-f82d-4678-92d1-05a82a0788b5 req-5d32fa44-83cf-411a-a989-e8b2c69cd2fa service nova] Creating event network-vif-plugged:dd9ce4d7-eac9-49bf-a75b-895d5cdce0df for instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 on hv-cinder-83754 Jul 18 16:45:46.464816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-f717911c-f82d-4678-92d1-05a82a0788b5 req-5d32fa44-83cf-411a-a989-e8b2c69cd2fa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065433 Jul 18 16:45:46.466027 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 373/749] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:46.473716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:46.488465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-100297f3-9428-4fd6-94f7-d9fec53efbc8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.480589 Jul 18 16:45:46.489438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 377/750] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:46 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:47.422709 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:47.423397 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:47.429989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:47.430464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:47.431215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:47.431641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:47.506035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:47.506775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:47.515490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:47.516020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:47.516873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:47.517493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:47.596875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:47.606375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7611d38c-d006-4282-9eac-c3e5b4b520d3 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.188751 Jul 18 16:45:47.606988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 374/751] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:47 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:47.678926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:47.686683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4c049f32-1f4b-4f78-8548-9dd3e85e6946 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1361 microversion: 2.1 time: 0.184448 Jul 18 16:45:47.687457 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 378/752] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:47 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:48.182147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:48.182712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:48.190201 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.190624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.191419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.191859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.217914 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lazy-loading 'flavor' on Instance uuid e4044d28-5c30-4cd6-bf2a-60f15452a314 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:45:48.484481 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ac2e4882-86c0-450d-9a58-b99a43bb9437 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/action" status: 202 len: 0 microversion: 2.20 time: 0.308416 Jul 18 16:45:48.487647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 375/753] 10.222.0.77 () {62 vars in 1318 bytes} [Mon Jul 18 16:45:48 2022] POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:45:48.488439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-57265a8d-b5ca-4fa2-8714-768fa5762abc req-ba1c4807-0ed7-478f-b994-5be71c62502b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c987f41-b103-4e2c-b6e6-4ae1ce4e241c", "name": "network-vif-plugged", "status": "completed", "tag": "9aae68b8-0df8-486e-a0d5-0405e1d676fb"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:48.501220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:48.502690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:48.513442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.514721 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.516401 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.516615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-57265a8d-b5ca-4fa2-8714-768fa5762abc req-ba1c4807-0ed7-478f-b994-5be71c62502b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.517175 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-57265a8d-b5ca-4fa2-8714-768fa5762abc req-ba1c4807-0ed7-478f-b994-5be71c62502b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.517277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.529589 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-57265a8d-b5ca-4fa2-8714-768fa5762abc req-ba1c4807-0ed7-478f-b994-5be71c62502b service nova] Creating event network-vif-plugged:9aae68b8-0df8-486e-a0d5-0405e1d676fb for instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c on hv-cinder-83754 Jul 18 16:45:48.535304 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-57265a8d-b5ca-4fa2-8714-768fa5762abc req-ba1c4807-0ed7-478f-b994-5be71c62502b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053626 Jul 18 16:45:48.536019 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 379/754] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:48.632296 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:48.633162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:48.648591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.649157 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.650061 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.650628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.753041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:48.768717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:48.772969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:48.775717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-08fb55db-49d9-4acc-a6b2-91540e4e42db tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.282676 Jul 18 16:45:48.777532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 376/755] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:48 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:45:48.787665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:48.789204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:48.799008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.799802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.801099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:48.802037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:48.858015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:48.872968 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e98ed4fa-b534-4fe1-b509-6dc218263f38 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.245002 Jul 18 16:45:48.874331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 380/756] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:48 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:48.970858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:48.979740 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bdb5819d-5ee4-446e-b5f0-8261c34bac57 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1548 microversion: 2.1 time: 0.200266 Jul 18 16:45:48.980334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 377/757] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:48 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:48.999586 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:49.000038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:49.007410 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.007842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:49.008735 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.009219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:49.349871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a48a60b6-dd86-41c6-b466-7f12c6ffc595 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.355994 Jul 18 16:45:49.350655 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 381/758] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:45:48 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-interface => generated 285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:49.811108 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:49.812284 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:49.825476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.826251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:49.827672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.828460 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:49.897119 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:49.898371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:49.908944 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.909609 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:49.911033 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:49.912324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:50.112919 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:50.126611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fbc3371e-84a2-4db0-bbe7-570700e4b943 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.237634 Jul 18 16:45:50.127481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 382/759] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:49 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:50.411347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:50.427078 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:50.429683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:50.432439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bc0865fa-4c9c-4a43-b1a5-a21c7ddee250 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.628248 Jul 18 16:45:50.434359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 378/760] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:49 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:50.848329 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-f5393f5f-6d8c-4b26-82a0-82bd404f0951 req-394f7050-c8c2-4a18-b12e-946954bab863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb2c5ba-19c9-4812-9da4-a074d69d56f4", "tag": "dd9ce4d7-eac9-49bf-a75b-895d5cdce0df"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:50.861805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f5393f5f-6d8c-4b26-82a0-82bd404f0951 req-394f7050-c8c2-4a18-b12e-946954bab863 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:50.862614 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f5393f5f-6d8c-4b26-82a0-82bd404f0951 req-394f7050-c8c2-4a18-b12e-946954bab863 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:50.877408 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-f5393f5f-6d8c-4b26-82a0-82bd404f0951 req-394f7050-c8c2-4a18-b12e-946954bab863 service nova] Creating event network-changed:dd9ce4d7-eac9-49bf-a75b-895d5cdce0df for instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 on hv-cinder-83754 Jul 18 16:45:50.883258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-f5393f5f-6d8c-4b26-82a0-82bd404f0951 req-394f7050-c8c2-4a18-b12e-946954bab863 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040465 Jul 18 16:45:50.883938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 383/761] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:51.153783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:51.154852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:51.162879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:51.163534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:51.164449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:51.165003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:51.201646 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:51.376354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:51.386430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e0dcd99f-8972-49f9-af3a-39a700572fc4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.237601 Jul 18 16:45:51.387168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 379/762] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:51 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:51.453380 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:51.454210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:51.462062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:51.462555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:51.463349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:51.463790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:51.668180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:51.679705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:51.681837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:51.683914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4f785e4f-0975-4312-976e-b44ec482b337 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.235390 Jul 18 16:45:51.684696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 384/763] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:51 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:52.412466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:52.413266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:52.420420 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:52.421116 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:52.421942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:52.422375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:52.583044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:52.591964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e1710494-76f5-4bab-aec9-8749890f33af tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.183990 Jul 18 16:45:52.592570 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 380/764] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:52 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:52.703906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:52.704547 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:52.712124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:52.712570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:52.713352 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:52.713791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:52.866598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:52.875823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:52.877466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:52.878736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1b869bf2-6776-4c7a-accd-36750418a2b1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.178978 Jul 18 16:45:52.879310 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 385/765] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:52 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:53.616390 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:53.618751 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:53.631768 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.632694 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:53.634193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.635065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:53.834953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:53.843366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7a0ddc3b-4df7-4276-88a4-fbbe54ebddce tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1366 microversion: 2.1 time: 0.235725 Jul 18 16:45:53.843962 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 381/766] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:53 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:53.902831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:53.903970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:53.916423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.917249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:53.918758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.919559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:54.134604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:54.143470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:54.144970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:54.146753 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3fc5db27-bc78-4336-b1e1-60c064858d6f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.251728 Jul 18 16:45:54.147326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 386/767] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:53 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:54.861496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:54.862065 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:54.869842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:54.870636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:54.871458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:54.871902 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:55.039398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:55.048154 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-18052a9a-1728-43c4-9346-b41e7cbc1b77 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1557 microversion: 2.1 time: 0.190628 Jul 18 16:45:55.048742 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 382/768] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:54 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:45:55.065706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:55.066284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:55.073971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:55.074437 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:55.075220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:55.075652 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:55.094451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:55.164804 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-307c5e63-e7b4-4cf9-b900-6e7833a018e9 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102627 Jul 18 16:45:55.165929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 387/769] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:45:55 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:55.181830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:55.183374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:55.196006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:55.196813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:55.198154 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:55.198936 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:55.450731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:55.461177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:55.463135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:55.464682 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-67f14273-ae2b-4f68-9d70-dc37a944592a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.300796 Jul 18 16:45:55.465415 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 383/770] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:55 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:56.419273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-d93e6084-2df2-427d-8777-002ac92e5b34 req-4578de90-27df-4d6b-b692-9128b18dace0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c987f41-b103-4e2c-b6e6-4ae1ce4e241c", "tag": "9aae68b8-0df8-486e-a0d5-0405e1d676fb"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:56.423271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:56.431995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-d93e6084-2df2-427d-8777-002ac92e5b34 req-4578de90-27df-4d6b-b692-9128b18dace0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:56.432906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-d93e6084-2df2-427d-8777-002ac92e5b34 req-4578de90-27df-4d6b-b692-9128b18dace0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:56.447355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-d93e6084-2df2-427d-8777-002ac92e5b34 req-4578de90-27df-4d6b-b692-9128b18dace0 service nova] Creating event network-changed:9aae68b8-0df8-486e-a0d5-0405e1d676fb for instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c on hv-cinder-83754 Jul 18 16:45:56.452983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-d93e6084-2df2-427d-8777-002ac92e5b34 req-4578de90-27df-4d6b-b692-9128b18dace0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038140 Jul 18 16:45:56.454113 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 388/771] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:56.490782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:56.491708 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:56.504491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:56.507374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:56.509466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:56.510292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:56.772974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:56.787026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:56.789896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:56.790721 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3c6daf3f-6fdf-4cb1-93ef-600746a18afc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.308779 Jul 18 16:45:56.794453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 384/772] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:56 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:57.827229 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:57.829363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:57.845644 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:57.846486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:57.847905 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:57.848735 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:58.040294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:58.049858 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:58.051412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:58.053126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d9b7e015-530a-4eb8-bcc1-d2d34a2e605d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.235978 Jul 18 16:45:58.053712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 389/773] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:57 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:45:59.076363 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:59.077493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:59.081629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:59.092848 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:59.093609 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:59.095005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:59.095761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:59.297377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:59.307793 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:59.309282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:59.310511 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9b1f7fd2-0e8d-4bda-a3a5-f3d2e15e6b84 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.241475 Jul 18 16:45:59.311070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 385/774] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:45:59 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:00.336414 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:00.337558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:00.348584 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:00.349933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:00.351541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:00.352326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:00.601938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:00.611006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:00.612634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:00.613860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a42a06e6-c97a-4f6f-b3e7-a28d0783fe44 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.285754 Jul 18 16:46:00.614506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 390/775] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:00 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:01.634866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:01.636051 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:01.647430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:01.647888 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:01.648727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:01.649172 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:01.796270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:01.806507 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:01.808028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:01.809272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-81f41b14-bac0-47ae-a22c-26f67815661b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.180773 Jul 18 16:46:01.809858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 386/776] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:01 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:02.832093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:02.833453 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:02.844745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:02.845316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:02.846108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:02.846596 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:02.995640 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:03.005188 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:03.006807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:03.008246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-394148aa-f43e-40c5-a889-683ae1bbacb8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.182632 Jul 18 16:46:03.008820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 391/777] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:02 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:04.028965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:04.029844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:04.037951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:04.038604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:04.039626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:04.040207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:04.217321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:04.230755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:04.234161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:04.236459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-57e94e7f-a230-4df8-a6c5-6cf9c3e71ac7 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.211458 Jul 18 16:46:04.237455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 387/778] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:04 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:05.260075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:05.260881 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:05.269514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:05.270107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:05.271119 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:05.271700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:05.449848 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:05.458810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:05.460339 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:05.461523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a1a7a2dc-a291-4c50-9283-020b28ff8642 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1745 microversion: 2.20 time: 0.206109 Jul 18 16:46:05.462093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 392/779] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:05 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:06.481186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:06.481804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:06.489095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:06.489592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:06.490318 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:06.490780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:06.690966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:06.707106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:06.710879 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:06.713765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f5f49418-7f51-4efa-baeb-18d92450c19b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.236166 Jul 18 16:46:06.714560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 388/780] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:06 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:07.735989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:07.737634 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:07.750181 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:07.751553 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:07.753278 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:07.754393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:08.020530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:08.041351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:08.043616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:08.048779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b9d36671-61c3-4812-841d-0fcba16f1d9d tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.318271 Jul 18 16:46:08.049687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 393/781] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:07 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:09.074991 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:09.076663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:09.089791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:09.090334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:09.091434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:09.092113 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:09.285141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:09.294759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:09.296684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:09.298156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1f51cec6-fe48-4804-8328-b910f14afecb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.229760 Jul 18 16:46:09.298804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 389/782] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:09 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:10.195487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-fc745fc3-a152-49e2-9be6-bf4da656722c req-54549010-d363-4a0b-a661-146a07297cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "name": "network-vif-plugged", "status": "completed", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:10.221865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-fc745fc3-a152-49e2-9be6-bf4da656722c req-54549010-d363-4a0b-a661-146a07297cff service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.224370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-fc745fc3-a152-49e2-9be6-bf4da656722c req-54549010-d363-4a0b-a661-146a07297cff service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.255313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-fc745fc3-a152-49e2-9be6-bf4da656722c req-54549010-d363-4a0b-a661-146a07297cff service nova] Creating event network-vif-plugged:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:46:10.268056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-fc745fc3-a152-49e2-9be6-bf4da656722c req-54549010-d363-4a0b-a661-146a07297cff service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081945 Jul 18 16:46:10.270988 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 394/783] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:10.328128 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:10.331155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:10.344772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.345950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.347482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.348269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.611960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:10.626885 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:10.629798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:10.633070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ae6091b4-5794-40ee-884b-c6620c51196f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.309536 Jul 18 16:46:10.634126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 390/784] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:10 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:11.659201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:11.661984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:11.673555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:11.674613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:11.675780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:11.676575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:11.796992 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:11.798316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:11.810071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:11.810871 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:11.811840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:11.812471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:11.889861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:46:11.954574 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:11.972018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:11.976343 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:11.978236 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-dafde50a-1914-481a-aa7e-1f308c3fd0a2 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.326964 Jul 18 16:46:11.979407 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 395/785] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:11 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:12.043969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c07eddc3-ee1e-45c4-bf39-536a83fd8732 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "DELETE /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 204 len: 0 microversion: 2.1 time: 0.251098 Jul 18 16:46:12.044835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 391/786] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:46:11 2022] DELETE /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:46:12.061127 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:12.062964 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:12.078005 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.078984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.081138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.082075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.273902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:12.289451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3baa15e1-a167-4553-9121-ada290344f73 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1579 microversion: 2.1 time: 0.239208 Jul 18 16:46:12.290801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 396/787] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:12 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:13.003619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.004872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:13.016274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.016950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:13.018135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.018825 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:13.250910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:13.261612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:13.263625 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:13.264514 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-585ad572-a61f-4b17-91e3-6558a31a6bbc tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.268106 Jul 18 16:46:13.271676 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 392/788] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:12 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:13.324608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.326544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:13.339914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.339914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:13.340806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.341502 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:13.552970 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:13.567257 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-58295815-61ac-4d06-a56a-e4162241456a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1579 microversion: 2.1 time: 0.251350 Jul 18 16:46:13.582896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 397/789] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:13 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1579 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:14.287202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:14.288267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:14.309865 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:14.314234 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:14.316359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:14.317568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:14.532283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.543548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.546006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.547431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-60da5fb1-3eb3-43ed-be82-03177ebfea78 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.267715 Jul 18 16:46:14.550460 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 393/790] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:14 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:14.593250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:14.594676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:14.603263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:14.604718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:14.605808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:14.606286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:14.852403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.861548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-db03c2a9-100c-4dec-8a05-fe293a389562 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1579 microversion: 2.1 time: 0.272140 Jul 18 16:46:14.867283 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 398/791] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:14 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1579 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:15.430645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-e0caa1c5-b6f0-44f9-b8bd-57db72a48510 req-1acea3ef-9fb6-43ec-b59f-fa6c12b14a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c69462-5393-447e-96d5-cda144e8d328", "name": "network-vif-deleted", "tag": "b74452ca-033c-40d3-b50d-968df23f2d86"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:15.447231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e0caa1c5-b6f0-44f9-b8bd-57db72a48510 req-1acea3ef-9fb6-43ec-b59f-fa6c12b14a9e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.447946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-e0caa1c5-b6f0-44f9-b8bd-57db72a48510 req-1acea3ef-9fb6-43ec-b59f-fa6c12b14a9e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.465466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-e0caa1c5-b6f0-44f9-b8bd-57db72a48510 req-1acea3ef-9fb6-43ec-b59f-fa6c12b14a9e service nova] Creating event network-vif-deleted:b74452ca-033c-40d3-b50d-968df23f2d86 for instance 59c69462-5393-447e-96d5-cda144e8d328 on hv-cinder-83754 Jul 18 16:46:15.474466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-e0caa1c5-b6f0-44f9-b8bd-57db72a48510 req-1acea3ef-9fb6-43ec-b59f-fa6c12b14a9e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054220 Jul 18 16:46:15.479330 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 394/792] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:15.585990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.586764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:15.595613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.596902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.598979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.599690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.775490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.786564 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.788463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.790194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cdcafd6d-0ee1-4dab-957d-ea41cbccd4e5 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.212598 Jul 18 16:46:15.791368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 399/793] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:15.881859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.882658 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:15.889746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.890274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.891058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.891498 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.917801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:15.999400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:16.009713 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-65d7a4f4-b7bd-4dfe-914b-b784fa3ffa0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 200 len: 1226 microversion: 2.1 time: 0.132231 Jul 18 16:46:16.010969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 395/794] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:16.824123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:16.827062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:16.844972 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.846554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:16.850077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.851606 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.027191 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:17.028568 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:17.035950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.036770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.038574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.039288 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.056693 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] HTTP exception thrown: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Request method failure captured: Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 HTTP/1.1 Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y1_acCGawY1Rt1oUtS3WJXCImSR775I4Y34L8NM3KR_v_F1umWClxSMFxUjTvb6lY8A6_IBOQ7N1VP-fj371GZ2nTWfecAX36ouGhD6gMEhFL8vomhPVSwR73nn8wJYQLMbVUbPL0wOZwCqhGwzg1uRE-_0FQV5P_bvJIAFP6eF7Qg Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:46:17.058781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_edffd84b958d4e2a880fae7c4709d36d", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestVolumeBootPattern-86073174 Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 6c7e0694c5ab46a4adef7a1f7b1fed4c Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:46:17.060147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '59c69462-5393-447e-96d5-cda144e8d328'} Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:17.060955 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:46:17.062210 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:17.065034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Returning 404 to user: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:17.066002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a2ae5003-25e4-4b7c-94fc-f244b3605315 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 404 len: 111 microversion: 2.1 time: 0.042783 Jul 18 16:46:17.067807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 396/795] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:17 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:46:17.136775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:17.153091 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:17.156286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:17.158627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-995d544f-1d72-4ba9-9239-cb2984fc5316 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1740 microversion: 2.20 time: 0.351232 Jul 18 16:46:17.160045 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 400/796] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:16 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:17.248022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-921052959", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1011843527", "security_groups": [{"name": "tempest-secgroup-smoke-977181763"}], "block_device_mapping_v2": [{"uuid": "6c281bd4-f88e-4d5f-838a-7c7e2855ac3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94186e07-4092-42bb-bef4-09c745cebf42"}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:17.403459 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] validate_networks() for [('94186e07-4092-42bb-bef4-09c745cebf42', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:46:17.907545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:46:17.908107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:46:17.908707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:46:17.909215 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:46:17.909724 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:46:17.921332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.921829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.922792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.923314 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.944035 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:46:17.949335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for user 6c7e0694c5ab46a4adef7a1f7b1fed4c and project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:46:18.049847 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:46:18.054791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c281bd4-f88e-4d5f-838a-7c7e2855ac3d',volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:46:18.183895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:18.185716 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:18.198335 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.199206 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.200839 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.201549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.242244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9f5bd374-0be3-4466-a7f5-4f1e49886dc6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.998435 Jul 18 16:46:18.243042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 397/797] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:46:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:46:18.256753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-01e30226-89a8-4e18-8aaf-f3d50e7fd07d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:18.257732 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-01e30226-89a8-4e18-8aaf-f3d50e7fd07d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:18.323350 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-01e30226-89a8-4e18-8aaf-f3d50e7fd07d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.331213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-01e30226-89a8-4e18-8aaf-f3d50e7fd07d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1094 microversion: 2.1 time: 0.078695 Jul 18 16:46:18.341840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 398/798] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:18 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:18.509676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.523064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.525794 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.528058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ed3eada7-e158-4cf6-bc5e-2f19f275fe79 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1722 microversion: 2.20 time: 0.350903 Jul 18 16:46:18.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 401/799] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:18 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:19.349789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:19.350338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:19.357469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.357947 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.358772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.359208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.429419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.437551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a166e29a-3bb0-4965-bba7-a6a1bf66b2a0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1192 microversion: 2.1 time: 0.092085 Jul 18 16:46:19.438148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 399/800] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:19 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:19.548021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:19.548642 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:19.556774 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.557223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.558008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.558475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.710035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.725072 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.727951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.730008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-028af374-5260-4b72-a187-536085ed1d1b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1722 microversion: 2.20 time: 0.185942 Jul 18 16:46:19.730989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 402/801] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:19 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:20.117867 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-7d744b5b-5ccd-4b0f-8c83-f5c50d82ad95 req-05306f86-4e2e-4937-a908-76d0cb47e429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "name": "network-vif-unplugged", "status": "completed", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:20.135437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-7d744b5b-5ccd-4b0f-8c83-f5c50d82ad95 req-05306f86-4e2e-4937-a908-76d0cb47e429 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.136269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-7d744b5b-5ccd-4b0f-8c83-f5c50d82ad95 req-05306f86-4e2e-4937-a908-76d0cb47e429 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.152458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-7d744b5b-5ccd-4b0f-8c83-f5c50d82ad95 req-05306f86-4e2e-4937-a908-76d0cb47e429 service nova] Creating event network-vif-unplugged:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:46:20.158038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-7d744b5b-5ccd-4b0f-8c83-f5c50d82ad95 req-05306f86-4e2e-4937-a908-76d0cb47e429 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047263 Jul 18 16:46:20.158703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 400/802] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:20.454236 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:20.454882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:20.461490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.461985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.462940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.463560 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.531351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.539351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b99b9caf-2f6e-4ccf-b3be-9c7c3e908708 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1192 microversion: 2.1 time: 0.088982 Jul 18 16:46:20.539934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 403/803] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:20 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:20.757651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:20.758241 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:20.765464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.765903 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.766727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.767156 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.946221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.955207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.956726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.958660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-eb5488ce-bc12-474e-894f-78d03af077bb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1722 microversion: 2.20 time: 0.206078 Jul 18 16:46:20.959242 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 401/804] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:20 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:21.556604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:21.557267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:21.564209 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.564658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.565436 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.565885 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.639765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:21.648453 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8633f361-f12d-452e-8f56-555345f7b1e9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1210 microversion: 2.1 time: 0.095646 Jul 18 16:46:21.649378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 404/805] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:21 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:21.978593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:21.979394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:21.987061 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.987619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.988953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.989395 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.190212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:22.207449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:22.211610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:22.214509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2d71e65b-53f8-4b2e-b269-3ac6e532c853 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1665 microversion: 2.20 time: 0.240077 Jul 18 16:46:22.215965 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 402/806] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:21 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1665 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:22.246728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb9a0c8-ab11-4338-b755-1a03a1a94040"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:22.248002 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:22.256046 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.256552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.257361 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.257798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.360517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=100 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:22.671057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:22.672246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:22.683658 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.684408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.685694 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.686435 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.780626 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-214bf2e8-f6a7-41b4-9c62-2bf53e4c53e0 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.538403 Jul 18 16:46:22.785657 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 405/807] 10.222.0.77 () {62 vars in 1363 bytes} [Mon Jul 18 16:46:22 2022] POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments => generated 188 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:46:22.893486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:22.903476 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-85cc2aa5-8c07-4619-8f13-61e14ffc504a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.240967 Jul 18 16:46:22.916537 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 403/808] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:22 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:22.988714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:22.989399 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:22.995791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.996233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.997010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.997438 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.381312 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cc63053e-b5bd-4be5-b307-81d3a6f2814a tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments/5fb9a0c8-ab11-4338-b755-1a03a1a94040" status: 202 len: 0 microversion: 2.20 time: 0.397203 Jul 18 16:46:23.381987 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 406/809] 10.222.0.77 () {60 vars in 1456 bytes} [Mon Jul 18 16:46:22 2022] DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments/5fb9a0c8-ab11-4338-b755-1a03a1a94040 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:46:23.450185 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:23.452120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:23.464776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.465978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.467524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.468527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.499111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-e3399f86-f504-4ef0-b010-eeabc8013957 req-e394bbe9-b91b-459e-a876-9daf8d399450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a39496-e159-4eb3-8522-e4c71db90cb2", "tag": "f17f0179-7c66-4506-9262-82d958940f77"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:23.523581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e3399f86-f504-4ef0-b010-eeabc8013957 req-e394bbe9-b91b-459e-a876-9daf8d399450 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.524318 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-e3399f86-f504-4ef0-b010-eeabc8013957 req-e394bbe9-b91b-459e-a876-9daf8d399450 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.546725 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-e3399f86-f504-4ef0-b010-eeabc8013957 req-e394bbe9-b91b-459e-a876-9daf8d399450 service nova] Creating event network-changed:f17f0179-7c66-4506-9262-82d958940f77 for instance 81a39496-e159-4eb3-8522-e4c71db90cb2 on hv-cinder-83754 Jul 18 16:46:23.555922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-e3399f86-f504-4ef0-b010-eeabc8013957 req-e394bbe9-b91b-459e-a876-9daf8d399450 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063493 Jul 18 16:46:23.557353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 407/810] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:23.656806 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-192e086b-5e60-48b8-8439-20458e951207 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/action" status: 202 len: 0 microversion: 2.20 time: 0.214705 Jul 18 16:46:23.658974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 404/811] 10.222.0.77 () {62 vars in 1318 bytes} [Mon Jul 18 16:46:23 2022] POST /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:46:23.667926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:23.686947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:23.699487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.700324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.701535 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.702210 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.923788 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:23.924398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:23.931791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.932240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.933229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.933651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.024594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.059651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.069404 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.071643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b23cfa83-099d-4113-a55a-2134d4dbecaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1673 microversion: 2.20 time: 0.408617 Jul 18 16:46:24.084066 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 408/812] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:23 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1673 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:24.119473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.129998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-28a57396-b88c-4b63-af13-ecf56b25a00d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.210149 Jul 18 16:46:24.138466 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 405/813] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:23 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:25.090611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:25.091305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:25.099013 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.099463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.100261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.100904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.151250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:25.151928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:25.161640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.162229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.163079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.163509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.396596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.411984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c635db4d-7297-406c-afbc-2d2e0ccbf1b8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.263992 Jul 18 16:46:25.413001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 406/814] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:25 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:25.536735 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.545592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.547124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.548308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-168acd4e-84b4-482b-88cb-76ed01fd1893 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1675 microversion: 2.20 time: 0.462000 Jul 18 16:46:25.548884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 409/815] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:25 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1675 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:26.437317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:26.437958 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:26.444500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.444957 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.445736 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.446180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.571329 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:26.572736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:26.577129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=44 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:26.585762 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.587051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.588668 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.589604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.652651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.668059 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-24636569-0450-4563-b119-602b5a08430d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.234233 Jul 18 16:46:26.669354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 407/816] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:26 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:26.838824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.854257 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.857490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.860487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-93679776-c1a4-4011-ae24-4a2a1156e877 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.294640 Jul 18 16:46:26.875377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 410/817] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:26 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:27.688572 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:27.689294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:27.696563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.697011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.698023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.698651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.866801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:27.875918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a5476331-1948-425f-b9e1-d72b3a682d3c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.191813 Jul 18 16:46:27.876722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 408/818] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:27 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:27.890850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:27.891485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:27.899241 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.899699 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.900490 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.900928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.066478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:28.076433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:28.077928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:28.079150 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7a81d342-922c-42ad-9488-c5961bd8d379 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.192338 Jul 18 16:46:28.079715 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 411/819] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:27 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:28.902809 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:28.903843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:28.907352 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:28.908380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=8 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:28.916044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.916489 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.917411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.917871 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.104978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:29.106077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:29.109651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.117665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:29.118396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6ec1b24d-a667-47a8-a5b2-9bed4e235a84 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.224661 Jul 18 16:46:29.121327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.123079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 409/820] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:28 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:29.123921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:29.125220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.307710 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.316620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.318195 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.319758 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-66a32b26-4685-4ba7-9fb9-cb700edeace9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.224857 Jul 18 16:46:29.320350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 412/821] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:29 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:30.147006 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:30.147620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:30.150109 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:30.155810 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.156247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.157034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.157471 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.334362 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:30.341965 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:30.344359 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:30.360567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-abafde61-f46b-48a8-8f4f-1f9dc6509934 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.217967 Jul 18 16:46:30.361370 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 410/822] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:30 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:30.362450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.364217 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.365897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.366727 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.545800 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:30.554813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:30.556319 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:30.557517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-334ea62c-e219-40f0-aa05-8444df80a1f8 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.223154 Jul 18 16:46:30.558760 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 413/823] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:30 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:31.382620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:31.384067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:31.396705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.397595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.399122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.399926 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.586346 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:31.588256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:31.596156 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.596725 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.598215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.598683 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.613562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.626886 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ed506ea0-d295-46e0-a013-80cfef3aa3ef tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.250669 Jul 18 16:46:31.640374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 411/824] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:31 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:31.788144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.802230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.805363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.807633 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c0ed3cee-ac3e-4c05-b0e1-a13f66b88bd9 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.225090 Jul 18 16:46:31.809140 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 414/825] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:31 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:32.658303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:32.659565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:32.673522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.674012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.675592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.676379 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.833565 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:32.836938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:32.852834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.853351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.854187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.854669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.906683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:32.927488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2439bd9d-e573-4b38-8b18-fb44f0227e2a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.273338 Jul 18 16:46:32.929147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 412/826] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:32 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:33.131488 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:33.143101 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:33.144304 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:33.146402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-30042cce-7748-43f3-b95f-41c28f771704 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.321383 Jul 18 16:46:33.147202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 415/827] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:32 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:33.959222 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:33.960493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:33.973683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.975018 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:33.976914 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.978057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.175063 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:34.176499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:34.188401 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.189362 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.190756 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.193476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.202150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:34.207857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:34.215767 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c520f4d4-5dc8-455f-9472-29c81cfada6d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.264980 Jul 18 16:46:34.216479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 413/828] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:33 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:34.414865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:34.425187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:34.426902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:34.428860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2b449319-7a46-43c0-8f63-86d51ec24763 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.259180 Jul 18 16:46:34.429468 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 416/829] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:34 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:34.774166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:34.775093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:34.786960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.787851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.789296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.790582 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.994693 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a7a1bdcb-54ae-4b73-b0c6-5ba58c68e51d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/ips" status: 200 len: 147 microversion: 2.1 time: 0.229539 Jul 18 16:46:34.995757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 414/830] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:46:34 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/ips => generated 147 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:35.234973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:35.235747 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:35.242975 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.243450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.244186 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.244611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.417859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:35.427908 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e882c182-a61b-41d5-bb6c-2d0b4e36be6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.196819 Jul 18 16:46:35.428957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 417/831] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:35 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:35.447008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:35.447750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:35.454057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.454687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.455637 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.456107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.651044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:35.663844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:35.666437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:35.667888 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3013987f-dd4b-429c-bfe9-24d65ce53197 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.224827 Jul 18 16:46:35.668527 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 415/832] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:35 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:36.445582 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:36.446233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:36.453500 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.454029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.454865 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.455366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.458816 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:36.599679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.607755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9d2ff218-b2e8-4a8c-bb60-a8a12ce1e31f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.166305 Jul 18 16:46:36.608347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 418/833] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:36 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:36.687148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:36.687804 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:36.695207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.695657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.696433 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.696866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.848345 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.857427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.858941 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.860129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-39f1fbd2-fb1e-42b6-a546-797e554e5eaa tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.176887 Jul 18 16:46:36.860682 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 416/834] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:36 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:46:37.413532 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d02530-254b-4b8a-a984-7e60284ec11e"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:37.415523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.427112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.427939 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.429319 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.430104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.625530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:37.626138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.632316 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.632748 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.633519 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.633952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.784005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:37.792635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0e823801-16a5-4739-bf87-fef95307dcb6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.171386 Jul 18 16:46:37.793204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 417/835] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:37 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:37.879069 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:37.879700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.886282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.886776 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.887593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.888063 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.033541 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:38.043180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:38.044967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:38.046172 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8c232208-3652-49eb-85aa-4a7d96e8e8c6 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.171212 Jul 18 16:46:38.046782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 418/836] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:37 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:38.816975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:38.819726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:38.834182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.836416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.837890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.839439 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.872371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-98c22276-cf00-4e5a-891e-ef1a6f7c1745 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.468478 Jul 18 16:46:38.874648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 419/837] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:46:37 2022] POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:39.072746 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:39.074159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:39.087311 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.088364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.090007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.090979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.099764 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.117550 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6ef5112f-ccbe-4b3a-93cd-384d630e5986 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.305343 Jul 18 16:46:39.119350 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 419/838] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:38 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:39.270948 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.279582 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.281082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.282429 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5680bc60-55e6-4c40-80e6-91415f0739f3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.219459 Jul 18 16:46:39.283185 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 420/839] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:39 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:40.140369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:40.141546 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:40.153410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.154157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.155671 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.156478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.303515 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:40.305850 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:40.319895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.320712 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.322220 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.323235 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.393441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.404555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1b340415-44b4-48b7-8d65-bb42c2b6da76 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.271519 Jul 18 16:46:40.405489 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 420/840] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:40 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:40.543266 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.553493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.555141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.556516 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-eab6c13c-b24b-4d73-82a1-ec8a32d029a1 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.258424 Jul 18 16:46:40.557148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 421/841] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:40 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:40.611798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:40.612335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:40.619629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.620069 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.620842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.621267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.647894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4d516caa-4ed4-4bc4-8919-84ca5f8456e6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/ips" status: 200 len: 151 microversion: 2.1 time: 0.039892 Jul 18 16:46:40.648460 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 421/842] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:46:40 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:41.432815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:41.433497 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:41.442022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.442505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.443307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.443745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.576700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:41.577555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:41.584554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.584993 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.585779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.586208 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.601323 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:41.609759 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b66ef792-b231-498b-bf0f-ffda02c01572 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.181097 Jul 18 16:46:41.610350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 422/843] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:41 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:41.769216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:41.777852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:41.779376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:41.780570 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9a5a6728-1598-4c62-a364-399e2f1cf6eb tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.207925 Jul 18 16:46:41.781119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 422/844] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:41 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:42.113805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c35953f-c06c-42dd-a272-e3337919172e"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:42.115136 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:42.125182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.125941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.127640 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.128369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.462857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1c0357e8-2e14-47ce-8361-c0f7b981d030 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "POST /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356201 Jul 18 16:46:42.463704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 423/845] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:46:42 2022] POST /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:42.491973 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-1eed90d5-fc7b-4d54-b2f1-a17e413875a9 req-16c98dae-b5d9-46a3-8816-b2b9a9ec68c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a39496-e159-4eb3-8522-e4c71db90cb2", "name": "network-vif-plugged", "status": "completed", "tag": "f17f0179-7c66-4506-9262-82d958940f77"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:42.505309 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-1eed90d5-fc7b-4d54-b2f1-a17e413875a9 req-16c98dae-b5d9-46a3-8816-b2b9a9ec68c3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.505530 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-1eed90d5-fc7b-4d54-b2f1-a17e413875a9 req-16c98dae-b5d9-46a3-8816-b2b9a9ec68c3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.521408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-1eed90d5-fc7b-4d54-b2f1-a17e413875a9 req-16c98dae-b5d9-46a3-8816-b2b9a9ec68c3 service nova] Creating event network-vif-plugged:f17f0179-7c66-4506-9262-82d958940f77 for instance 81a39496-e159-4eb3-8522-e4c71db90cb2 on hv-cinder-83754 Jul 18 16:46:42.527623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-1eed90d5-fc7b-4d54-b2f1-a17e413875a9 req-16c98dae-b5d9-46a3-8816-b2b9a9ec68c3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042280 Jul 18 16:46:42.528202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 423/846] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:42.636728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:42.637665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:42.646276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.646797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.647599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.648101 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.801227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:42.801928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:42.809247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.809696 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.811290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.811728 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.836853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:42.854969 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-88297713-bc46-42f1-a58e-2972b9e2bbbe tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.222347 Jul 18 16:46:42.856828 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 424/847] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:42 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:43.007636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:43.016668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:43.018185 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:43.019982 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dda495f8-c27a-4c90-8081-30b20737ad1f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.223671 Jul 18 16:46:43.020583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 424/848] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:42 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:43.879986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:43.880744 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:43.887399 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:43.887935 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:43.888773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:43.889251 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.041050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:44.041782 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:44.049538 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.050009 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.051400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.051840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.061763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.074897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ebcefa82-714f-4a3f-a207-cf43304b33b0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1265 microversion: 2.1 time: 0.198392 Jul 18 16:46:44.075830 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 425/849] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:43 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:44.224044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.238492 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.240378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.242103 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0148d2af-c192-4a42-b1c2-ed6eacbe9e6b tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.205394 Jul 18 16:46:44.243076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 425/850] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:44 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:44.556018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-8443141f-facf-4e19-b215-9a32ff840fb3 req-b634bde2-4612-474f-bc15-b79745e3c0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "name": "network-vif-plugged", "status": "completed", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:44.564925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-8443141f-facf-4e19-b215-9a32ff840fb3 req-b634bde2-4612-474f-bc15-b79745e3c0d6 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.565368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-8443141f-facf-4e19-b215-9a32ff840fb3 req-b634bde2-4612-474f-bc15-b79745e3c0d6 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.577739 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-8443141f-facf-4e19-b215-9a32ff840fb3 req-b634bde2-4612-474f-bc15-b79745e3c0d6 service nova] Creating event network-vif-plugged:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:46:44.583611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-8443141f-facf-4e19-b215-9a32ff840fb3 req-b634bde2-4612-474f-bc15-b79745e3c0d6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 Jul 18 16:46:44.584219 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 426/851] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:45.094182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:45.094987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:45.102649 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.103500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.104394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.104831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.261821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.269710 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:45.270471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:45.276162 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-15dcd888-1d93-46a5-9774-e30fd8b75eba tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1452 microversion: 2.1 time: 0.185437 Jul 18 16:46:45.277220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 426/852] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:45 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:45.277522 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.277978 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.278861 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.279297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.295826 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:45.296445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:45.303126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.303590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.304363 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.304806 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.476571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.482311 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.488631 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.490745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.492456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6a3f2a85-5cbf-4868-9f15-0cd411e85026 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.226823 Jul 18 16:46:45.503772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-15daa429-76d3-426e-887e-ce5ba7090e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1452 microversion: 2.1 time: 0.205728 Jul 18 16:46:45.503772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 427/853] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:45 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:45.504448 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 427/854] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:45 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:46.514536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:46.516044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:46.527451 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.528281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.529685 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.530469 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.562269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b86d7166-a55f-49b3-b6c2-a4525e14c37d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:46.573205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b86d7166-a55f-49b3-b6c2-a4525e14c37d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.573667 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b86d7166-a55f-49b3-b6c2-a4525e14c37d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.653356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b86d7166-a55f-49b3-b6c2-a4525e14c37d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Going to try to stop instance {{(pid=129671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:46:46.718069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b86d7166-a55f-49b3-b6c2-a4525e14c37d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action" status: 202 len: 0 microversion: 2.1 time: 0.162298 Jul 18 16:46:46.724107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 428/855] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:46:46 2022] POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:46:46.736657 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:46.738037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:46.750234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.751159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.753559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.754369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.854333 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:46.866590 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:46.868514 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:46.869989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f22b7d98-6216-48e8-b640-60526f48027c tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1731 microversion: 2.20 time: 0.361884 Jul 18 16:46:46.881580 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 428/856] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:46 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1731 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:46.990179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:47.006506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-803cf070-1ae1-4d76-bbd2-ae625532896b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.277560 Jul 18 16:46:47.007576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 429/857] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:46 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:47.893585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:47.897560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:47.907988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:47.908786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:47.910885 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:47.911820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:47.953527 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-9679a255-fa32-488c-acfc-8b6dc729153c req-3c6d15eb-810d-4322-baa4-5426ef1da687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a39496-e159-4eb3-8522-e4c71db90cb2", "tag": "f17f0179-7c66-4506-9262-82d958940f77"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:47.970366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-9679a255-fa32-488c-acfc-8b6dc729153c req-3c6d15eb-810d-4322-baa4-5426ef1da687 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:47.971236 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-9679a255-fa32-488c-acfc-8b6dc729153c req-3c6d15eb-810d-4322-baa4-5426ef1da687 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:47.994922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-9679a255-fa32-488c-acfc-8b6dc729153c req-3c6d15eb-810d-4322-baa4-5426ef1da687 service nova] Creating event network-changed:f17f0179-7c66-4506-9262-82d958940f77 for instance 81a39496-e159-4eb3-8522-e4c71db90cb2 on hv-cinder-83754 Jul 18 16:46:48.002936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-9679a255-fa32-488c-acfc-8b6dc729153c req-3c6d15eb-810d-4322-baa4-5426ef1da687 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057708 Jul 18 16:46:48.004248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 430/858] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:48.033365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:48.034095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:48.041790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:48.042249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:48.043077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:48.043508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:48.125637 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:48.136224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:48.138173 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:48.140207 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9c662255-f70a-4085-82e1-c487b15c05d3 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1718 microversion: 2.20 time: 0.255692 Jul 18 16:46:48.155218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 429/859] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:46:47 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1718 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:46:48.371445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:48.380269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-42066485-daff-43cd-a860-2d949b60c514 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.351469 Jul 18 16:46:48.380733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 431/860] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:48 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:49.397567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:49.398354 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:49.405056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:49.405507 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:49.406283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:49.406750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:49.548726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:49.558594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d933d7c0-344f-4b3b-a665-aeab6f1d707a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.164834 Jul 18 16:46:49.559180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 430/861] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:49 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:50.576785 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:50.577430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:50.585125 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:50.585567 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:50.586928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:50.587294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:50.604135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:50.747056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:50.756620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4ca2de67-d488-4952-a93f-d62a6743f2d8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.183812 Jul 18 16:46:50.757213 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 432/862] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:50 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:51.774045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:51.774840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:51.781781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:51.782279 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:51.783145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:51.783647 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:51.930915 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:51.935351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:51.942584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-40ed9879-89aa-4be3-9830-d68a285c1061 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.172452 Jul 18 16:46:51.943284 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 431/863] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:51 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:52.965852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:52.966737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:52.974772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.975370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:52.976632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.977353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.125811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:53.134860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-04782330-61d6-4c36-92fe-12f7b55d0fe5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.172752 Jul 18 16:46:53.135507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 433/864] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:52 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:53.433571 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:53.434175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:53.441090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.442069 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.442974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.443531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.531007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'services' on Instance uuid 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:46:53.611999 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-50f397e2-8e30-4dee-b986-6eeceb0c7cff tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments/2c35953f-c06c-42dd-a272-e3337919172e" status: 202 len: 0 microversion: 2.1 time: 0.182182 Jul 18 16:46:53.613080 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 432/865] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:46:53 2022] DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments/2c35953f-c06c-42dd-a272-e3337919172e => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:46:53.623237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:53.624599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:53.635357 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.636206 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.637123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.637673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.672690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bd1c8387-cc90-48a5-97fe-85e00f834b10 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054194 Jul 18 16:46:53.673285 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 434/866] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:46:53 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:54.153816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.154535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.162110 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.162593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.163393 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.163821 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.311237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:54.319845 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fdb1f548-7085-4a28-bbb8-480c8ab257b0 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.170447 Jul 18 16:46:54.320470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 433/867] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:54 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:54.686607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.687536 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.694895 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.695334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.696124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.696547 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.727206 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-44c52198-8b3f-4752-ae0d-d9131947cd88 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045341 Jul 18 16:46:54.727780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 435/868] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:46:54 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:46:54.797730 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.798480 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.805061 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.805460 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.806237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.806727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.833601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:46:54.916396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1d219a46-ce57-4e12-8e26-89f837cfe1c4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 204 len: 0 microversion: 2.1 time: 0.122233 Jul 18 16:46:54.917206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 434/869] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:46:54 2022] DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:46:54.932419 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.933032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.939139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.939619 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.940441 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.941541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:55.085599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:55.093662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e3819230-6c52-4af3-8ac4-fdcadb77e3da tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1682 microversion: 2.1 time: 0.170543 Jul 18 16:46:55.094331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 436/870] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:54 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:55.338014 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:55.338645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:55.345148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:55.345604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:55.346438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:55.347385 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:55.498929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:55.507421 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c8c85928-2fa7-424c-a6cf-c3279f0f0251 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.173965 Jul 18 16:46:55.508146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 435/871] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:55 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:56.111034 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:56.111662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:56.118499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.118903 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.119660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.120084 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.263015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:56.271417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-47ddbf2e-a617-49b1-bca2-a777428fa8d6 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1682 microversion: 2.1 time: 0.164291 Jul 18 16:46:56.272008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 437/872] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:56 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:56.524884 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:56.525557 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:56.531651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.532091 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.532845 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.533264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.675624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:56.684789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d0583afa-9fb5-47b9-8096-b7525cda1098 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.163634 Jul 18 16:46:56.685373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 436/873] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:56 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:57.290394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:57.290999 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:57.293412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=56 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:57.299362 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.299807 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.300621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.301062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.505845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:57.515759 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-06941465-34e7-4d7a-a0d2-205603aff3f4 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1682 microversion: 2.1 time: 0.229596 Jul 18 16:46:57.516556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 438/874] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:57 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:57.701975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:57.703053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:57.710951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.711406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.712190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.712620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.881858 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:57.896260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-675f19a0-f5f6-4b1e-8337-9cb973f8400f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.198342 Jul 18 16:46:57.897143 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 437/875] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:57 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:57.937277 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-bc492910-e6e5-4642-813a-1f2fdf815470 req-7124b4c3-808c-4daf-98e8-fe1ee9a6cb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c987f41-b103-4e2c-b6e6-4ae1ce4e241c", "name": "network-vif-deleted", "tag": "9aae68b8-0df8-486e-a0d5-0405e1d676fb"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:57.947271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-bc492910-e6e5-4642-813a-1f2fdf815470 req-7124b4c3-808c-4daf-98e8-fe1ee9a6cb1f service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.947594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-bc492910-e6e5-4642-813a-1f2fdf815470 req-7124b4c3-808c-4daf-98e8-fe1ee9a6cb1f service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.961332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-bc492910-e6e5-4642-813a-1f2fdf815470 req-7124b4c3-808c-4daf-98e8-fe1ee9a6cb1f service nova] Creating event network-vif-deleted:9aae68b8-0df8-486e-a0d5-0405e1d676fb for instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c on hv-cinder-83754 Jul 18 16:46:57.969227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-bc492910-e6e5-4642-813a-1f2fdf815470 req-7124b4c3-808c-4daf-98e8-fe1ee9a6cb1f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035469 Jul 18 16:46:57.969837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 439/876] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:58.538297 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:58.538979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:58.546431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.546881 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.547649 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.548087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.583184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.583721 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.584178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lazy-loading 'fault' on Instance uuid 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:46:58.636823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd1061f505d4249ae14c7cbf68a950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9c6bf5b0c491299815d545c1a594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:58.645663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a472e393-04b4-486b-af2a-0d5d876411fb tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 200 len: 1331 microversion: 2.1 time: 0.113408 Jul 18 16:46:58.646532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 438/877] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:58 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:58.920423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:58.921288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:58.927647 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.928092 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.928878 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.929314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.088491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:59.103641 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-87ff4806-488e-4ab3-b807-41e64565b437 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.187759 Jul 18 16:46:59.104658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 440/878] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:58 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:59.664277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:59.664918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:59.672365 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.672813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.673601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.674032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.689353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c HTTP/1.1 Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:46:59.691624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:46:59.694248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '3c987f41-b103-4e2c-b6e6-4ae1ce4e241c'} Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:59.695802 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:46:59.698317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:46:59.700558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:59.700558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-17451cb6-9829-4e04-bee0-243d23b5adee tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 404 len: 111 microversion: 2.1 time: 0.033122 Jul 18 16:46:59.700558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 439/879] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:59 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:46:59.702300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e329b4c0-0feb-4564-8d91-3e1b2e1ec139 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '.version_select at 0x7fc3a1e11700>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:59.723389 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e329b4c0-0feb-4564-8d91-3e1b2e1ec139 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834522683" status: 202 len: 0 microversion: 2.1 time: 0.024885 Jul 18 16:46:59.724138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 441/880] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 18 16:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834522683 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:47:00.121455 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:00.122402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:00.129329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.130031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.131120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.131727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.305920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:00.318195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-10266397-e976-4b7b-baec-b45e05431971 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.200714 Jul 18 16:47:00.319000 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 440/881] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:00 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:01.339810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:01.340423 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:01.347875 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.348330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.349095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.349524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.494591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:01.503365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e8a3a6fb-35da-433c-88a7-edf2e009bbb7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.167371 Jul 18 16:47:01.503980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 442/882] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:01 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:01.901744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:01.902259 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:01.904618 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:01.910633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.911078 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.911851 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.912286 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.939493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c HTTP/1.1 Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:01.941057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.942483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '3c987f41-b103-4e2c-b6e6-4ae1ce4e241c'} Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:01.943269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.944701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.946160 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:01.946160 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7d66855d-3146-49c9-93db-752db571abe5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 404 len: 111 microversion: 2.1 time: 0.044719 Jul 18 16:47:01.946160 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 441/883] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:47:01 2022] DELETE /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:01.953475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:01.954884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:01.965055 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.965505 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.966325 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.966852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.982034 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c HTTP/1.1 Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:01.983837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.986215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '3c987f41-b103-4e2c-b6e6-4ae1ce4e241c'} Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:01.987755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. Jul 18 16:47:01.990015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:01.992124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 3c987f41-b103-4e2c-b6e6-4ae1ce4e241c could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:01.992124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-54263edc-3112-48bb-a684-791d8831660b tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c" status: 404 len: 111 microversion: 2.1 time: 0.037694 Jul 18 16:47:01.992124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 443/884] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:01 2022] GET /compute/v2.1/servers/3c987f41-b103-4e2c-b6e6-4ae1ce4e241c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:02.521014 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:02.521626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:02.527990 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:02.528442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:02.529225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:02.529660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:02.680641 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:02.691166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-15bc94e1-7b6a-4105-99f6-8f10c0211b6c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.173449 Jul 18 16:47:02.691766 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 442/885] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:02 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:03.139866 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.140460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.147957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.148403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.149173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.149607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.165112 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 HTTP/1.1 Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:03.166720 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.169659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '2041fced-2b7e-4c58-998e-a14e43cd2707'} Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:03.170876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.172334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.173639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:03.173639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e24919d4-ffca-43c5-80ed-cc62b0cac38a tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 404 len: 111 microversion: 2.1 time: 0.032485 Jul 18 16:47:03.173639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 444/886] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:47:03 2022] DELETE /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:47:03.177763 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.178823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 2041fced-2b7e-4c58-998e-a14e43cd2707] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.196728 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.197285 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.198101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.198586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.215104 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 HTTP/1.1 Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:03.216700 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.218805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '2041fced-2b7e-4c58-998e-a14e43cd2707'} Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:03.220353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. Jul 18 16:47:03.223593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.226026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 2041fced-2b7e-4c58-998e-a14e43cd2707 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:03.226026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2b311f96-535c-4724-b5e5-174173829c4d tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707" status: 404 len: 111 microversion: 2.1 time: 0.044389 Jul 18 16:47:03.226026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 443/887] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:03 2022] GET /compute/v2.1/servers/2041fced-2b7e-4c58-998e-a14e43cd2707 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:47:03.229518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.230025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.236617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.237065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.237868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.238303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.255765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: DELETE /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 HTTP/1.1 Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:03.257704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.260050 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': 'b744aaad-a923-464c-8879-90ccec466724'} Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:03.261518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.263869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.266176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:03.266176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-765d569c-bdf3-4b6c-847a-4d65c1278518 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 404 len: 111 microversion: 2.1 time: 0.035485 Jul 18 16:47:03.266176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 445/888] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:47:03 2022] DELETE /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:03.272140 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.272810 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: b744aaad-a923-464c-8879-90ccec466724] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.279129 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.279583 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.280358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.280792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.295799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 HTTP/1.1 Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:03.297361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.299952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'b744aaad-a923-464c-8879-90ccec466724'} Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:03.301381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. Jul 18 16:47:03.303979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:03.306226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance b744aaad-a923-464c-8879-90ccec466724 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:03.306226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0bd49099-5789-486b-8474-1a3bae2cede5 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724" status: 404 len: 111 microversion: 2.1 time: 0.032624 Jul 18 16:47:03.306226 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 444/889] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:03 2022] GET /compute/v2.1/servers/b744aaad-a923-464c-8879-90ccec466724 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:47:03.710982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.712065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.724579 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.725032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.725982 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.726479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.881313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:03.902281 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-56d7c4ed-74b1-4855-b1c0-cef49f652a41 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.196800 Jul 18 16:47:03.902818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 446/890] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:03 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:04.454691 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.455575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.462703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.463243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.464111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.464701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.480142 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd HTTP/1.1 Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:04.481866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.484778 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '642fda3b-e6f4-48c5-ba7f-d619553351fd'} Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:04.486119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.489087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.491783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:04.491783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4505f1da-7c27-469e-b2dc-2bd65ceb0c59 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 404 len: 111 microversion: 2.1 time: 0.033155 Jul 18 16:47:04.491783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 445/891] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:47:04 2022] DELETE /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:47:04.494677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.495394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] [instance: 642fda3b-e6f4-48c5-ba7f-d619553351fd] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.503012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.503475 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.504366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.504890 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.520089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] HTTP exception thrown: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Request method failure captured: Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd HTTP/1.1 Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Yy87oV8acSUqE1b7sdxxH3uWCrd83g6eyWAotjZtus2c-GQqtwLJJVAUHnM67h2D3Te4Vnj6RW5Wt-R93edYttXG9pYvuLKdg6uyEKA3Kp3oXNFiSEyxBpvUI1YNigHYXyFVZOy2CXU5A3n0PMokDsr6YsoK_9S07KNLeIaxMDs5do Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:04.521669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_dbd9c6bf5b0c491299815d545c1a594e", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/dbd9c6bf5b0c491299815d545c1a594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: dbd9c6bf5b0c491299815d545c1a594e Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1127741051 Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 8bd1061f505d4249ae14c7cbf68a950a Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeNegativeTest-1127741051-project Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.523297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '642fda3b-e6f4-48c5-ba7f-d619553351fd'} Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:04.527580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. Jul 18 16:47:04.529083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.530542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] Returning 404 to user: Instance 642fda3b-e6f4-48c5-ba7f-d619553351fd could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:04.530542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-45c51e6e-24c1-402a-b6ba-2d4067408037 tempest-AttachVolumeNegativeTest-1127741051 tempest-AttachVolumeNegativeTest-1127741051-project] 10.222.0.77 "GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd" status: 404 len: 111 microversion: 2.1 time: 0.034122 Jul 18 16:47:04.530542 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 447/892] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:04 2022] GET /compute/v2.1/servers/642fda3b-e6f4-48c5-ba7f-d619553351fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:04.923828 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.924934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.932375 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.932832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.933619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.934053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:05.087783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:05.096648 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a739f66b-eab9-4a1d-a588-25eff1e1c032 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.179233 Jul 18 16:47:05.097371 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 446/893] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:04 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:06.122880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:06.124378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:06.131331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.131894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.132682 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.133117 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.347521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:06.356984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8e536b03-321f-4fac-b54e-b0c840065cfb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1723 microversion: 2.1 time: 0.238125 Jul 18 16:47:06.357640 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 448/894] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:06 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:07.376008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:07.376853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:07.384807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:07.385346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:07.386224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:07.386751 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:07.622799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:07.635855 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b133361a-0eda-4bfe-a236-d7bb9db3a8bf tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1700 microversion: 2.1 time: 0.263455 Jul 18 16:47:07.636923 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 447/895] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:07 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1700 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:07.661279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-09730e7b-6846-45ff-bb0a-0aae94d271c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:07.677621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-09730e7b-6846-45ff-bb0a-0aae94d271c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:07.678576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-09730e7b-6846-45ff-bb0a-0aae94d271c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:07.719959 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-09730e7b-6846-45ff-bb0a-0aae94d271c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Going to try to start instance {{(pid=129671) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:47:07.790345 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-09730e7b-6846-45ff-bb0a-0aae94d271c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action" status: 202 len: 0 microversion: 2.1 time: 0.139856 Jul 18 16:47:07.791344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 449/896] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:47:07 2022] POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:47:07.805169 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:07.806278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:07.817792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:07.818443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:07.819368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:07.820029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:08.027630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:08.052794 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f1a9f66c-c96e-4a9a-8f19-67718d1bf089 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1709 microversion: 2.1 time: 0.255066 Jul 18 16:47:08.057570 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 448/897] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:07 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1709 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:09.081984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:09.082711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:09.089822 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:09.090269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:09.091348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:09.092721 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:09.270591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:09.281891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9a556d4d-d5d4-4fd4-84f9-c7235ac6cbe9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1709 microversion: 2.1 time: 0.206839 Jul 18 16:47:09.282786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 450/898] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:09 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1709 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:10.306050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:10.307168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:10.318249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:10.319047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:10.320389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:10.321170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:10.328969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:10.525194 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:10.533784 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-50e92185-0894-4fcd-ba8b-98142129e916 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1713 microversion: 2.1 time: 0.235566 Jul 18 16:47:10.534946 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 449/899] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:10 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1713 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:27.550095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:27.551872 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:27.556662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:27.557655 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:27.566005 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.566617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.567499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.567896 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.603104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cd1ce5c9-a734-43bd-ac41-873d2ab01b50 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061567 Jul 18 16:47:27.603813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 451/900] 10.222.0.77 () {60 vars in 1342 bytes} [Mon Jul 18 16:47:27 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:27.670368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:27.671261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:27.673366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=17 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:27.674051 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:27.681545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.682017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.682875 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.683358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.713849 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:47:27.813904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6d47e982-6cf9-4d69-b43b-21e2aef57f68 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 204 len: 0 microversion: 2.20 time: 0.146822 Jul 18 16:47:27.817998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 450/901] 10.222.0.77 () {60 vars in 1279 bytes} [Mon Jul 18 16:47:27 2022] DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 16:47:27.824776 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:27.825381 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:27.834354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.834954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.835743 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:27.836204 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:27.988912 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:27.997963 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:27.999577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:28.000805 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b9d01fc0-6bea-49cf-8f9d-2d9316e8b12f tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.181159 Jul 18 16:47:28.001373 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 452/902] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:27 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:47:29.021217 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:29.022055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:29.029951 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:29.030457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:29.031361 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:29.031891 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:29.190386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:29.199443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:29.201066 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:29.202273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8cf9030b-cc3a-473d-b4cb-e0fc2cce6b9e tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1724 microversion: 2.20 time: 0.185634 Jul 18 16:47:29.202935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 451/903] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:29 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:47:30.227645 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:30.230705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:30.244138 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:30.244936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:30.246258 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:30.247001 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:30.376426 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:30.386729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:30.390165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:30.391466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c062d5f2-f6c8-4f52-ab45-184eb2fa8140 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1656 microversion: 2.20 time: 0.174357 Jul 18 16:47:30.392089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 453/904] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:30 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:47:30.667005 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-894b58d7-c9db-42fc-b3a1-a0cf00dee4e1 req-95ff996e-70b5-420b-9015-42ca0e7fef49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4044d28-5c30-4cd6-bf2a-60f15452a314", "name": "network-vif-deleted", "tag": "cf08c27e-1532-45fb-ba35-fa7294ac40b0"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:30.690077 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-894b58d7-c9db-42fc-b3a1-a0cf00dee4e1 req-95ff996e-70b5-420b-9015-42ca0e7fef49 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:30.691890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-894b58d7-c9db-42fc-b3a1-a0cf00dee4e1 req-95ff996e-70b5-420b-9015-42ca0e7fef49 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:30.712247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-894b58d7-c9db-42fc-b3a1-a0cf00dee4e1 req-95ff996e-70b5-420b-9015-42ca0e7fef49 service nova] Creating event network-vif-deleted:cf08c27e-1532-45fb-ba35-fa7294ac40b0 for instance e4044d28-5c30-4cd6-bf2a-60f15452a314 on hv-cinder-83754 Jul 18 16:47:30.723106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-894b58d7-c9db-42fc-b3a1-a0cf00dee4e1 req-95ff996e-70b5-420b-9015-42ca0e7fef49 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066025 Jul 18 16:47:30.725960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 452/905] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:31.417425 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:31.421442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:31.436073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:31.436798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:31.437749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:31.438334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:31.477087 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:31.477529 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:31.477981 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lazy-loading 'fault' on Instance uuid e4044d28-5c30-4cd6-bf2a-60f15452a314 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:47:31.526846 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:31.542571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:31.546216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4909d4aef302404290adcd3268e53c1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a41505f0ce4a66a02a5d954da278cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:31.548637 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7f692592-edda-405a-87d5-68cdbe7ad289 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 200 len: 1372 microversion: 2.20 time: 0.138885 Jul 18 16:47:31.549755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 454/906] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:31 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 1372 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:47:32.569131 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:32.570157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:32.577427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:32.577897 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:32.578717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:32.579147 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:32.594068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 HTTP/1.1 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:32.595812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:32.599632 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'e4044d28-5c30-4cd6-bf2a-60f15452a314'} Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:32.601287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:32.603394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:32.605799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:32.605799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-bd9b2e86-d0c0-40fc-803b-42a18facf319 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 404 len: 111 microversion: 2.20 time: 0.033498 Jul 18 16:47:32.605799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 453/907] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:32 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:47:32.607881 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-79d4f39c-0425-48fb-9420-496f2d4b0507 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '.version_select at 0x7fc3a1d1c3a0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:32.626121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-79d4f39c-0425-48fb-9420-496f2d4b0507 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987402163" status: 204 len: 0 microversion: 2.20 time: 0.022212 Jul 18 16:47:32.626827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 455/908] 10.222.0.77 () {60 vars in 1261 bytes} [Mon Jul 18 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987402163 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 16:47:34.489353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:34.489950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:34.499331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.500115 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.501114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.501625 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.519045 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 HTTP/1.1 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:34.520629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.522227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'e4044d28-5c30-4cd6-bf2a-60f15452a314'} Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:34.523146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.524623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.525998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:34.525998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-efddb105-586d-4191-a6da-7b33d39cf048 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 404 len: 111 microversion: 2.20 time: 0.038458 Jul 18 16:47:34.525998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 454/909] 10.222.0.77 () {60 vars in 1279 bytes} [Mon Jul 18 16:47:34 2022] DELETE /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:47:34.531698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:34.532325 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: e4044d28-5c30-4cd6-bf2a-60f15452a314] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:34.539246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.539695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.540463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.540929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.555305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 HTTP/1.1 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:34.557455 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.559684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': 'e4044d28-5c30-4cd6-bf2a-60f15452a314'} Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:34.561128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. Jul 18 16:47:34.563305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:34.565929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance e4044d28-5c30-4cd6-bf2a-60f15452a314 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:34.565929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3cbeabbb-aec4-4e2c-8799-d54dcef3c8dd tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314" status: 404 len: 111 microversion: 2.20 time: 0.031387 Jul 18 16:47:34.565929 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 456/910] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:34 2022] GET /compute/v2.1/servers/e4044d28-5c30-4cd6-bf2a-60f15452a314 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:47:35.720118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:35.721027 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:35.732413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.732881 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.733890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.734442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.749753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 HTTP/1.1 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:35.751597 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.755106 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7'} Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:35.756283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.757974 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.760376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:35.760376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-79704e93-9f8a-4319-bf07-6744a3b80890 tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 404 len: 111 microversion: 2.20 time: 0.039854 Jul 18 16:47:35.760376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 455/911] 10.222.0.77 () {60 vars in 1279 bytes} [Mon Jul 18 16:47:35 2022] DELETE /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:47:35.763295 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:35.763914 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] [instance: 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:35.771456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.771916 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.772737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.773188 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.788635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] HTTP exception thrown: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Request method failure captured: Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 HTTP/1.1 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1YyyyOm6m53SxX5HXEaw7vx3FVS4n8Og9TplDJdcqHvP_R6cYRH5ZVbBv6pz3695lIWx7dIiB-xlcfgrKHrfyQjCXe40OkcUqSODGENycs7_SsqlJ7oFrD0diKOMOcrjhSW5DZJjvd6Cji2g2UWU9pyG6xOBSeVr7GNBSMBwxgAfnyE Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:35.790237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_26a41505f0ce4a66a02a5d954da278cb", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/26a41505f0ce4a66a02a5d954da278cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 26a41505f0ce4a66a02a5d954da278cb Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2133706291 Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 4909d4aef302404290adcd3268e53c1b Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2133706291-project Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.791989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7'} Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:35.792932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. Jul 18 16:47:35.794288 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:35.795931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] Returning 404 to user: Instance 2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:35.795931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-780397b0-fc48-40fc-a08a-faa915eb8fcf tempest-AttachVolumeShelveTestJSON-2133706291 tempest-AttachVolumeShelveTestJSON-2133706291-project] 10.222.0.77 "GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7" status: 404 len: 111 microversion: 2.20 time: 0.032247 Jul 18 16:47:35.795931 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 457/912] 10.222.0.77 () {60 vars in 1276 bytes} [Mon Jul 18 16:47:35 2022] GET /compute/v2.1/servers/2e292be6-60ae-4db1-bae3-4a3d4ef5ebe7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:47:41.727608 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0c723465-cc55-493b-baec-05ad70bf33ee tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Action: 'create', calling method: .version_select at 0x7fc3a1db0e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-241140379"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:42.095359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0c723465-cc55-493b-baec-05ad70bf33ee tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.547109 Jul 18 16:47:42.097152 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 456/913] 10.222.0.77 () {60 vars in 1154 bytes} [Mon Jul 18 16:47:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 550 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:47:42.113069 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-db811a1c-80af-40d1-a1a7-08f12f4d812c tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d84160>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:42.194832 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-db811a1c-80af-40d1-a1a7-08f12f4d812c tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 200 len: 344 microversion: 2.1 time: 0.089759 Jul 18 16:47:42.195520 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 458/914] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:42 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:43.208812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7f249ee3-3c8b-48fe-939e-9d4e99daa2e2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f77b80>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:43.264200 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7f249ee3-3c8b-48fe-939e-9d4e99daa2e2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 200 len: 344 microversion: 2.1 time: 0.060083 Jul 18 16:47:43.264836 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 457/915] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:43 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:44.277854 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2488d9d3-bb37-4af2-936c-741fad18d520 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d1c3a0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:44.363990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2488d9d3-bb37-4af2-936c-741fad18d520 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 200 len: 345 microversion: 2.1 time: 0.090545 Jul 18 16:47:44.364672 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 459/916] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:44 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:47:44.376792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7512949c-bfae-4bea-a34a-c498f222f11b tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Action: 'create', calling method: .version_select at 0x7fc3a1e34c10>, body: {"snapshot": {"volume_id": "90c1e6e9-39d1-45f0-b022-455bb90c5cda", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1938915035"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:44.555093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7512949c-bfae-4bea-a34a-c498f222f11b tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.182387 Jul 18 16:47:44.555929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 458/917] 10.222.0.77 () {60 vars in 1161 bytes} [Mon Jul 18 16:47:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:47:44.569860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7f52e02d-6121-4ce3-b1ce-860e1ea44ee1 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d1c160>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:44.608689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7f52e02d-6121-4ce3-b1ce-860e1ea44ee1 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 287 microversion: 2.1 time: 0.044782 Jul 18 16:47:44.609244 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 460/918] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:44 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:44.621194 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e2b2c539-aed7-4fc9-807c-31f8de759248 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f623a0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:44.651031 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e2b2c539-aed7-4fc9-807c-31f8de759248 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033638 Jul 18 16:47:44.651602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 459/919] 10.222.0.77 () {58 vars in 1139 bytes} [Mon Jul 18 16:47:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:44.662111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6e907580-2822-4a05-a92b-11bda1627bd4 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1e20dc0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:44.695040 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6e907580-2822-4a05-a92b-11bda1627bd4 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 287 microversion: 2.1 time: 0.037122 Jul 18 16:47:44.695603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 461/920] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:44 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:45.708757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1c7d2bf0-62d3-4bf2-b9b3-f8b537012617 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f6f280>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:45.728576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:45.741717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1c7d2bf0-62d3-4bf2-b9b3-f8b537012617 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 287 microversion: 2.1 time: 0.038419 Jul 18 16:47:45.742814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 460/921] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:45 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:46.751010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:46.751773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=30 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:46.756027 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-855047f7-5e86-4039-b565-df33ca0aa382 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d1ce50>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:46.788397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-855047f7-5e86-4039-b565-df33ca0aa382 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 287 microversion: 2.1 time: 0.038549 Jul 18 16:47:46.788975 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 462/922] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:46 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:47.796835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:47.801909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d4d7af52-c640-4351-8c8c-4e7e25527d9a tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f1daf0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:47.841529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d4d7af52-c640-4351-8c8c-4e7e25527d9a tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 288 microversion: 2.1 time: 0.045189 Jul 18 16:47:47.842152 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 461/923] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:47 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:47.858487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7024cf33-2d24-4217-889e-bbc0db00cf2d tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1dd03a0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:47.932653 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7024cf33-2d24-4217-889e-bbc0db00cf2d tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 202 len: 0 microversion: 2.1 time: 0.082168 Jul 18 16:47:47.933513 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 463/924] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 18 16:47:47 2022] DELETE /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:47:47.944515 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-113402c3-0186-4f34-9787-d37bdcf574df tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1e345e0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:47.979822 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-113402c3-0186-4f34-9787-d37bdcf574df tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 200 len: 287 microversion: 2.1 time: 0.041167 Jul 18 16:47:47.980575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 462/925] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:47 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:47:48.993388 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-347bce5a-102c-40ec-9bb6-cc6309433b38 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d84040>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:49.023973 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-347bce5a-102c-40ec-9bb6-cc6309433b38 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] HTTP exception thrown: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-347bce5a-102c-40ec-9bb6-cc6309433b38 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Request method failure captured: Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c HTTP/1.1 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y6tpxhxOMJKsdy3y-QNwsI_uIzpQKoVBGGr5FUDBsHj1ibEzNNRMZS7BP3TXEFacIaDPLzEROhiCDSWcOFHBawczMhOP12pa9PR9y7OIeDJrpFfRbhElYkhRvKacEi3IHHmq-8223ruenEFP6x1SSxx1OogBnZRFaGhkT3i2MaGltc Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:49.026379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_00d53375a6d3433987b24c1c6c4c68d1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: d1a02c8baa3141f0ad932f2a577000c6 Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '727e3216-3db8-48b7-a523-97acf01a8e5c'} Jul 18 16:47:49.028548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. (HTTP 404) (Request-ID: req-b8556d0d-bd66-46c6-af02-5bd171c7653f) Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.030267 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:49.032581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 16:47:49.035472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-347bce5a-102c-40ec-9bb6-cc6309433b38 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Returning 404 to user: Snapshot 727e3216-3db8-48b7-a523-97acf01a8e5c could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-347bce5a-102c-40ec-9bb6-cc6309433b38 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c" status: 404 len: 111 microversion: 2.1 time: 0.038866 Jul 18 16:47:49.037044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 464/926] 10.222.0.77 () {58 vars in 1250 bytes} [Mon Jul 18 16:47:48 2022] GET /compute/v2.1/os-snapshots/727e3216-3db8-48b7-a523-97acf01a8e5c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:49.047034 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3f7c47c7-ee99-4278-99d9-ef9e9dde9501 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1e34940>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:49.156058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3f7c47c7-ee99-4278-99d9-ef9e9dde9501 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 202 len: 0 microversion: 2.1 time: 0.114867 Jul 18 16:47:49.156823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 463/927] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:47:49 2022] DELETE /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:47:49.167130 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0cade069-ac32-415e-ac3f-06a40eb1ee3b tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1e20790>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:49.222159 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0cade069-ac32-415e-ac3f-06a40eb1ee3b tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 200 len: 344 microversion: 2.1 time: 0.059199 Jul 18 16:47:49.222860 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 465/928] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:49 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:50.234761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-70f7390e-5e3f-4158-b3b8-8a742bb306a8 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f77a60>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:50.278833 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-70f7390e-5e3f-4158-b3b8-8a742bb306a8 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] HTTP exception thrown: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-70f7390e-5e3f-4158-b3b8-8a742bb306a8 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Request method failure captured: Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda HTTP/1.1 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y6tpxhxOMJKsdy3y-QNwsI_uIzpQKoVBGGr5FUDBsHj1ibEzNNRMZS7BP3TXEFacIaDPLzEROhiCDSWcOFHBawczMhOP12pa9PR9y7OIeDJrpFfRbhElYkhRvKacEi3IHHmq-8223ruenEFP6x1SSxx1OogBnZRFaGhkT3i2MaGltc Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:50.280892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_00d53375a6d3433987b24c1c6c4c68d1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: d1a02c8baa3141f0ad932f2a577000c6 Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '90c1e6e9-39d1-45f0-b022-455bb90c5cda'} Jul 18 16:47:50.283292 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. (HTTP 404) (Request-ID: req-4b98125c-07df-47a4-be9f-0b9a28f84527) Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.285276 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:50.287501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:47:50.289729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-70f7390e-5e3f-4158-b3b8-8a742bb306a8 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Returning 404 to user: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-70f7390e-5e3f-4158-b3b8-8a742bb306a8 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 404 len: 109 microversion: 2.1 time: 0.052830 Jul 18 16:47:50.291843 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 464/929] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:50 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:50.307023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4339c1fb-b58a-4b59-9a88-e9f68405dfc2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1d84430>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:50.339242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-4339c1fb-b58a-4b59-9a88-e9f68405dfc2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] HTTP exception thrown: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4339c1fb-b58a-4b59-9a88-e9f68405dfc2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Request method failure captured: Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: DELETE /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda HTTP/1.1 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y6tpxhxOMJKsdy3y-QNwsI_uIzpQKoVBGGr5FUDBsHj1ibEzNNRMZS7BP3TXEFacIaDPLzEROhiCDSWcOFHBawczMhOP12pa9PR9y7OIeDJrpFfRbhElYkhRvKacEi3IHHmq-8223ruenEFP6x1SSxx1OogBnZRFaGhkT3i2MaGltc Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:47:50.341201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_00d53375a6d3433987b24c1c6c4c68d1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: d1a02c8baa3141f0ad932f2a577000c6 Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '90c1e6e9-39d1-45f0-b022-455bb90c5cda'} Jul 18 16:47:50.343599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. (HTTP 404) (Request-ID: req-06cfc60b-0873-48bb-94db-b2783b733984) Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.345172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:47:50.348082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:47:50.350227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4339c1fb-b58a-4b59-9a88-e9f68405dfc2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Returning 404 to user: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4339c1fb-b58a-4b59-9a88-e9f68405dfc2 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 404 len: 109 microversion: 2.1 time: 0.043220 Jul 18 16:47:50.352355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 466/930] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:47:50 2022] DELETE /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:50.355864 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cb3b863f-a58a-42e5-ae2c-d50fd29658c6 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Calling method '.version_select at 0x7fc3a1f6f550>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:50.389232 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-cb3b863f-a58a-42e5-ae2c-d50fd29658c6 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] HTTP exception thrown: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cb3b863f-a58a-42e5-ae2c-d50fd29658c6 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Request method failure captured: Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda HTTP/1.1 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y6tpxhxOMJKsdy3y-QNwsI_uIzpQKoVBGGr5FUDBsHj1ibEzNNRMZS7BP3TXEFacIaDPLzEROhiCDSWcOFHBawczMhOP12pa9PR9y7OIeDJrpFfRbhElYkhRvKacEi3IHHmq-8223ruenEFP6x1SSxx1OogBnZRFaGhkT3i2MaGltc Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:47:50.391376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_00d53375a6d3433987b24c1c6c4c68d1", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/00d53375a6d3433987b24c1c6c4c68d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 00d53375a6d3433987b24c1c6c4c68d1 Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-380270453 Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: d1a02c8baa3141f0ad932f2a577000c6 Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesSnapshotsTestJSON-380270453-project Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '90c1e6e9-39d1-45f0-b022-455bb90c5cda'} Jul 18 16:47:50.394238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. (HTTP 404) (Request-ID: req-fab2ca63-d7cb-4d07-ae2c-dadf2605db86) Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.395759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:47:50.398053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:47:50.400403 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cb3b863f-a58a-42e5-ae2c-d50fd29658c6 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] Returning 404 to user: Volume 90c1e6e9-39d1-45f0-b022-455bb90c5cda could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cb3b863f-a58a-42e5-ae2c-d50fd29658c6 tempest-VolumesSnapshotsTestJSON-380270453 tempest-VolumesSnapshotsTestJSON-380270453-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda" status: 404 len: 109 microversion: 2.1 time: 0.043407 Jul 18 16:47:50.402576 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 465/931] 10.222.0.77 () {58 vars in 1244 bytes} [Mon Jul 18 16:47:50 2022] GET /compute/v2.1/os-volumes/90c1e6e9-39d1-45f0-b022-455bb90c5cda => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:48:04.988775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:04.990769 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:05.002135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:05.003704 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:05.004750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:05.005666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:05.165088 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lazy-loading 'services' on Instance uuid 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:48:05.317208 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c2bd60ac-92a3-4257-be05-8b81b0fb5222 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments/65d02530-254b-4b8a-a984-7e60284ec11e" status: 202 len: 0 microversion: 2.1 time: 0.334209 Jul 18 16:48:05.337052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 467/932] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:48:04 2022] DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments/65d02530-254b-4b8a-a984-7e60284ec11e => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:48:06.700904 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fb47f890-4d12-498f-a8c3-6fb05bcb445e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:06.714161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb47f890-4d12-498f-a8c3-6fb05bcb445e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.714960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fb47f890-4d12-498f-a8c3-6fb05bcb445e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.874558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fb47f890-4d12-498f-a8c3-6fb05bcb445e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Going to try to stop instance {{(pid=129672) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:48:07.028698 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fb47f890-4d12-498f-a8c3-6fb05bcb445e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action" status: 202 len: 0 microversion: 2.1 time: 0.330598 Jul 18 16:48:07.032312 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 466/933] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:48:06 2022] POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:48:07.044177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:07.046610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:07.078076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.079398 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.081587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.082524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.716815 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:07.737954 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-80fd08c4-2624-4db7-b132-45ca8f65f1a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.700826 Jul 18 16:48:07.746323 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 468/934] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:07 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:08.773250 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:08.774442 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:08.784823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.785792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:08.787457 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.788429 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:09.142950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:09.163812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2b36ac7a-e8f0-439b-ba40-8332ecac633b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.398472 Jul 18 16:48:09.174895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 467/935] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:08 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:10.191058 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:10.191823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:10.221977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:10.222275 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:10.224078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:10.224521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:10.552382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:10.561599 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f75a8b12-77f5-4562-8396-321d2a8341bb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.381853 Jul 18 16:48:10.572544 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 469/936] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:10 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:11.586096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:11.588823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:11.606247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:11.607467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:11.608975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:11.609720 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:11.852604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:11.865812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2af5ccb4-ba30-4f33-8a28-2a51d5188056 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.288573 Jul 18 16:48:11.867273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 468/937] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:11 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:12.890003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:12.894543 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:12.912459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.916363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:12.922980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.924010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:13.438137 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:13.446598 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b5d7d66b-4ada-4b1f-8b2f-c9025a1c9ed6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.564508 Jul 18 16:48:13.456512 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 470/938] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:12 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:14.464862 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:14.465824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:14.475932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.479265 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.480465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.481163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.758461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:14.780720 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5dd87a39-0130-4a2d-8e7a-a78aee995558 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.318540 Jul 18 16:48:14.786633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 469/939] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:14 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:15.805554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:15.806274 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:15.822359 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.823278 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.825737 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.826614 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:16.154960 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:16.163965 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ef10a510-a8b7-44af-baca-d158b08ac961 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.363152 Jul 18 16:48:16.181788 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 471/940] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:15 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:17.201163 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:17.203461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:17.226601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.227791 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.231981 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.233126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.567220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:17.577829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-39f0b297-768d-4146-8fc6-9ee9c22d6e06 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1677 microversion: 2.1 time: 0.392972 Jul 18 16:48:17.582334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 470/941] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:17 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1677 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:18.615443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:18.617606 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:18.655172 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.656094 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.657852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.658879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.916314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:18.932263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-47d5bc88-88f2-48b7-ab16-c7d09ed462c9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1654 microversion: 2.1 time: 0.323578 Jul 18 16:48:18.932882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 472/942] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:18 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1654 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:18.965912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e1aeeaf0-0522-43c0-af89-066f446e3ee7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:18.976086 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1aeeaf0-0522-43c0-af89-066f446e3ee7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.976852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e1aeeaf0-0522-43c0-af89-066f446e3ee7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.047838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e1aeeaf0-0522-43c0-af89-066f446e3ee7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Going to try to start instance {{(pid=129672) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:48:19.150567 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e1aeeaf0-0522-43c0-af89-066f446e3ee7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action" status: 202 len: 0 microversion: 2.1 time: 0.179511 Jul 18 16:48:19.153581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 471/943] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:48:18 2022] POST /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:48:19.163131 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:19.163740 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:19.175610 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.176332 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.177486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.177917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.442175 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:19.459733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4c7f521c-c12d-4d5d-9891-24cbf85e2511 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1663 microversion: 2.1 time: 0.300154 Jul 18 16:48:19.461745 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 473/944] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:19 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1663 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:20.493311 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:20.497416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:20.513411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.514968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.517779 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.519960 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.914594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:20.932687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-af884d08-4e6c-4d0e-a685-e95497c135a2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1663 microversion: 2.1 time: 0.449615 Jul 18 16:48:20.934758 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 472/945] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:20 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1663 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:21.975875 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:21.978135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:21.985766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:21.986496 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:21.988313 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:21.988964 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.202403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:22.216857 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-039715da-d0b7-487e-9de0-20879e5a7a92 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1667 microversion: 2.1 time: 0.245228 Jul 18 16:48:22.217863 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 474/946] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:21 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1667 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:22.435462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'create', calling method: .version_select at 0x7fc3a1eb9310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2116320906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkpNfgmzLWQulAk+gbGsfeuWDyWryrLVer2pm4lSNTIcubmAQsbHpYFfiH44KBizOilt3eCKMpDdhhGRG5h7Ca0i5pyu26eHCDGJgon0Ue1FgRBEQF22fAmgNT3dWLHjA=="}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:22.451554 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Getting quotas for project 6343e3024ef0469da293401317da07f2. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:22.455773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Getting quotas for user b54a5070a23e45a3975c0fa0f2bcc76e and project 6343e3024ef0469da293401317da07f2. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:22.469149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR oslo.messaging._drivers.impl_rabbit [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [a57871aa-24a0-4255-a2eb-e8a731761595] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 16:48:23.477102 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [a57871aa-24a0-4255-a2eb-e8a731761595] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 59514. Jul 18 16:48:23.499534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-087fcd9a-a71a-4e08-b955-1ae0e1b1ed2d tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.067916 Jul 18 16:48:23.500360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 473/947] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:48:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:23.641364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1242550467", "imageRef": "7977db25-6f4b-4328-9c51-0a3683c9cad5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2116320906", "networks": [{"uuid": "d402c366-d682-43de-9024-57338c68fc5b"}]}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:23.718997 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.network.neutron [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] validate_networks() for [('d402c366-d682-43de-9024-57338c68fc5b', None, None, None, None, None)] {{(pid=129671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:24.281228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Flavor limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:24.281648 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Image limits 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:24.282126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Flavor pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:24.282644 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Image pref 0:0:0 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:24.283067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.virt.hardware [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:24.296160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.296806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.298733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.300121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.328006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Getting quotas for project 6343e3024ef0469da293401317da07f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:24.332728 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Getting quotas for user b54a5070a23e45a3975c0fa0f2bcc76e and project 6343e3024ef0469da293401317da07f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:24.345880 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Going to run 1 instances... {{(pid=129671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:24.348216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7977db25-6f4b-4328-9c51-0a3683c9cad5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:24.411433 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0a608272-cf4e-4bfc-8f3c-d9a145b702ca tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776604 Jul 18 16:48:24.412346 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 475/948] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:24.426398 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-51624745-1498-4892-98fc-60ccf0ee1ca6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:24.427635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-51624745-1498-4892-98fc-60ccf0ee1ca6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:24.520670 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-51624745-1498-4892-98fc-60ccf0ee1ca6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:24.532731 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-51624745-1498-4892-98fc-60ccf0ee1ca6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1259 microversion: 2.1 time: 0.113211 Jul 18 16:48:24.534383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 474/949] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:24 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1259 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:25.552922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:25.553525 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:25.560003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.560443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.561211 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.561747 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.650798 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:25.661621 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-15d4e8a7-e47e-4501-8aa4-656ed2ac003c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1311 microversion: 2.1 time: 0.112898 Jul 18 16:48:25.662524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 476/950] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:25 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:25.853792 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-60413185", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:25.920358 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] validate_networks() for None {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:26.269196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:26.269196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:26.269645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:26.270055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:26.270497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:26.284414 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.284872 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.285830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.286300 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.308035 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Getting quotas for project f614b9264ed14eab9e67ee4fca9b922c. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:26.313190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Getting quotas for user 34a4e3980f4d4cc98a4be829b351315c and project f614b9264ed14eab9e67ee4fca9b922c. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:26.328233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:26.330531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:26.390244 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [88af5d93-fb65-4abc-b723-6c042ce34bf5] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 16:48:26.693160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:26.694748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:26.720635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.723224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.725693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.726911 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.175166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:27.204082 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-568faf3d-239f-4abe-b127-4977bcb58533 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.516394 Jul 18 16:48:27.211875 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 477/951] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:26 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:27.400357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [88af5d93-fb65-4abc-b723-6c042ce34bf5] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 59598. Jul 18 16:48:27.405272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6181c47c-40c1-4e73-a523-e519b0e789c0 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555418 Jul 18 16:48:27.406200 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 475/952] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:27.432230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b008998f-29b7-45e9-9607-009c4c21e72f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:27.433941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b008998f-29b7-45e9-9607-009c4c21e72f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:27.572772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b008998f-29b7-45e9-9607-009c4c21e72f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:27.586156 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b008998f-29b7-45e9-9607-009c4c21e72f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1213 microversion: 2.1 time: 0.170136 Jul 18 16:48:27.594566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 478/953] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:27 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:28.094273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a7ae9f78-3cf4-441d-a787-78ab61deef2f req-8695466b-c6e5-4182-af42-3b85ab05319e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:28.108813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a7ae9f78-3cf4-441d-a787-78ab61deef2f req-8695466b-c6e5-4182-af42-3b85ab05319e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.110637 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a7ae9f78-3cf4-441d-a787-78ab61deef2f req-8695466b-c6e5-4182-af42-3b85ab05319e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.143896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a7ae9f78-3cf4-441d-a787-78ab61deef2f req-8695466b-c6e5-4182-af42-3b85ab05319e service nova] Creating event network-changed:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:48:28.151408 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-a7ae9f78-3cf4-441d-a787-78ab61deef2f req-8695466b-c6e5-4182-af42-3b85ab05319e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061635 Jul 18 16:48:28.152556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 476/954] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:28.243635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:28.245037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:28.258469 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.259202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.264945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.266356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.534331 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:28.554432 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-896f0d09-1a8c-49e7-afbb-7dbbc4240af2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.320915 Jul 18 16:48:28.556503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 479/955] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:28 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:28.614813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f7cb167b-e2d7-4563-9edc-757091797864 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:28.615620 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f7cb167b-e2d7-4563-9edc-757091797864 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:28.688841 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f7cb167b-e2d7-4563-9edc-757091797864 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:28.696665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f7cb167b-e2d7-4563-9edc-757091797864 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1213 microversion: 2.1 time: 0.086681 Jul 18 16:48:28.697252 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 477/956] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:28 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:29.572817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:29.573457 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:29.580483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.580932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.581943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.582382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.728264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-20ab5566-0f51-4eca-a68d-c4b7ad48b91f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:29.735047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-20ab5566-0f51-4eca-a68d-c4b7ad48b91f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:29.801369 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.813133 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7287e67d-6d5b-42a7-bd33-4c99e0430574 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.243295 Jul 18 16:48:29.814687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 480/957] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:29 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:29.851532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-20ab5566-0f51-4eca-a68d-c4b7ad48b91f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.859281 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-20ab5566-0f51-4eca-a68d-c4b7ad48b91f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1213 microversion: 2.1 time: 0.139162 Jul 18 16:48:29.860121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 478/958] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:29 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:30.834817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.836347 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.847854 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.848658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.849780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.850611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.876630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d2b2f433-2f29-4177-94e3-b82a5ddfe1eb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.877807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d2b2f433-2f29-4177-94e3-b82a5ddfe1eb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.985674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d2b2f433-2f29-4177-94e3-b82a5ddfe1eb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:30.997449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d2b2f433-2f29-4177-94e3-b82a5ddfe1eb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1213 microversion: 2.1 time: 0.124205 Jul 18 16:48:30.998346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 479/959] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:30 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:31.083083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:31.103570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fb69f621-63f9-4a0c-a294-2c4d6f8acc98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.275754 Jul 18 16:48:31.104447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 481/960] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:30 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:32.016405 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.017177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.026716 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.027166 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.027910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.028356 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.100153 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:32.108824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1d45c3c4-6b32-4292-a797-56bb73edcd0a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1217 microversion: 2.1 time: 0.096063 Jul 18 16:48:32.109716 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 480/961] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:32.130765 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.132202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.144099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.144986 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.146177 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.147026 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.311541 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:32.326549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-269f25a7-6839-4620-a817-84f83c33cf0c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.202427 Jul 18 16:48:32.327639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 482/962] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.128953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.129692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.139385 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.140746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.142831 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.143996 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.220683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.228984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cd953756-e9a3-4df7-a290-f8dc3420890c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1217 microversion: 2.1 time: 0.104765 Jul 18 16:48:33.229571 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 481/963] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:33.349078 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.350326 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.362119 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.362933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.364261 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.364764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.579791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.588587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0ac4cbb5-fda0-4765-b61b-8eba429fc42f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.246882 Jul 18 16:48:33.589153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 483/964] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:34.253890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:34.254629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:34.261430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.261876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.262975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.263390 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.337668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:34.345598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-22f151f3-f1b4-4aaf-ba88-373101ab7884 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1217 microversion: 2.1 time: 0.096281 Jul 18 16:48:34.346714 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 482/965] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:34 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:34.614166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:34.614861 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:34.616938 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:34.623593 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.624041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.624826 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.625273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.645940 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:34.786461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:34.794080 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bd4e3007-4b4c-4cf0-bab3-cfb14bea0710 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.184374 Jul 18 16:48:34.794698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 484/966] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:34 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:35.363260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:35.363992 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:35.371141 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.371584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.372378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.372819 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.452050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:35.465150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8123acac-62fb-4e2d-8618-4384b958721c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1265 microversion: 2.1 time: 0.106056 Jul 18 16:48:35.466015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 483/967] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:35 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:35.813713 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:35.814576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:35.822440 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:35.825379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.826075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.827158 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.827953 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.248866 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:36.258623 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-77702563-8105-4f27-bf6f-7ee22dd891a9 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.450190 Jul 18 16:48:36.259239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 485/968] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:35 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:36.484249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:36.484877 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:36.487105 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:36.493563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.493984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.494805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.495237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.570468 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:36.578565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ac9e1f5b-a0f5-4fb1-a5e0-77dd4311932f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1271 microversion: 2.1 time: 0.098266 Jul 18 16:48:36.579170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 484/969] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:36 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:37.277430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:37.278212 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:37.287157 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.288047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.289086 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.289628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.462039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:37.470030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-87edf134-e302-4c93-98f9-417ded92f86e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.197094 Jul 18 16:48:37.470677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 486/970] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:37 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:37.597171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:37.597850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:37.600240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:37.613231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.613688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.614501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.614939 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.618482 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:37.776179 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:37.785503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-91ce3f6d-6712-4351-b1d5-fcf334ce612a tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.192646 Jul 18 16:48:37.786454 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 485/971] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:37 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:38.378643 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-5ae06c04-dbc6-49d3-a326-528a20900e59 req-5e6370c8-7b18-496a-92fd-bc578cc242a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584ff3d0-8b5c-4713-a1ab-d01d05162442", "tag": "bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:38.382483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=8 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:38.390068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-5ae06c04-dbc6-49d3-a326-528a20900e59 req-5e6370c8-7b18-496a-92fd-bc578cc242a5 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.390561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-5ae06c04-dbc6-49d3-a326-528a20900e59 req-5e6370c8-7b18-496a-92fd-bc578cc242a5 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.412269 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-5ae06c04-dbc6-49d3-a326-528a20900e59 req-5e6370c8-7b18-496a-92fd-bc578cc242a5 service nova] Creating event network-changed:bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f for instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 on hv-cinder-83754 Jul 18 16:48:38.422382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-5ae06c04-dbc6-49d3-a326-528a20900e59 req-5e6370c8-7b18-496a-92fd-bc578cc242a5 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047655 Jul 18 16:48:38.423249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 487/972] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:38.495711 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:38.497801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:38.509746 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.510573 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.512003 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.512783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.692712 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:38.704513 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9780dd1b-7200-496c-b87f-88062060fa5b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.219094 Jul 18 16:48:38.705251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 486/973] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:38 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:38.815130 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:38.819492 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:38.834575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.835017 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.835806 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.836240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.072936 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:39.081030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-959dc691-04d9-4141-90fb-3871a0f05fd7 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.274116 Jul 18 16:48:39.081627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 488/974] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:38 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:39.723486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:39.724259 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:39.731087 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:39.731529 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.732311 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:39.732743 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.892254 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:39.900661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-04f0a7b7-0787-4223-9841-54d231146987 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.181105 Jul 18 16:48:39.901164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 487/975] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:39 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:40.098983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:40.099845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:40.106729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.107324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.108250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.108945 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.336984 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:40.345010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b4f24392-02d2-497a-a6d0-76244e740823 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.250560 Jul 18 16:48:40.345612 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 489/976] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:40 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:40.918542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:40.919157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:40.927136 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.927584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.928384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.928829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.996998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=18 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:41.073565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:41.081773 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f4de566c-0e79-4256-8187-694c9fc9c6b1 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.167290 Jul 18 16:48:41.082350 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 488/977] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:40 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:41.369853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:41.370651 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:41.377797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.378248 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.379658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.380249 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.561934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:41.576687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-03f27330-d655-41e2-89eb-87ecf9ebfc62 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.210847 Jul 18 16:48:41.577290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 490/978] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:41 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:42.102444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:42.103214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:42.110452 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.111012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.112378 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.112846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.281413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:42.292400 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f9e3883a-f452-4356-bf18-664ea7a59221 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.194271 Jul 18 16:48:42.293041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 489/979] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:42 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:42.595307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:42.596412 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:42.603202 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.603657 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.604443 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.604879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.770273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:42.781900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5800db87-53bf-46fc-9bcc-f12fc5deaf88 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.190300 Jul 18 16:48:42.782943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 491/980] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:42 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:43.117335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-16e12389-6c6a-42a4-a8b1-69aad662de4d req-64702cef-1a6d-4051-8e32-47fb86076d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "name": "network-vif-plugged", "status": "completed", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:43.126561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-16e12389-6c6a-42a4-a8b1-69aad662de4d req-64702cef-1a6d-4051-8e32-47fb86076d42 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.127336 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-16e12389-6c6a-42a4-a8b1-69aad662de4d req-64702cef-1a6d-4051-8e32-47fb86076d42 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.143303 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-16e12389-6c6a-42a4-a8b1-69aad662de4d req-64702cef-1a6d-4051-8e32-47fb86076d42 service nova] Creating event network-vif-plugged:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:48:43.148745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-16e12389-6c6a-42a4-a8b1-69aad662de4d req-64702cef-1a6d-4051-8e32-47fb86076d42 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035352 Jul 18 16:48:43.149438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 490/981] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:43.312322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:43.313015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:43.320107 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.320569 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.321990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.322517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.784239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:43.792676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c0a1b9d1-bd88-42bc-bc09-f6ae41292591 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.484742 Jul 18 16:48:43.793264 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 492/982] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:43 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:43.801753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:43.802569 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:43.809137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.809687 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.810619 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.811050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.971795 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:43.980029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b461ae58-0669-4204-b358-f9ac3fb2a7d9 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.183114 Jul 18 16:48:43.980606 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 491/983] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:43 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:44.812042 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:44.812697 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:44.820346 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.820797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.821571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.822006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.964247 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:44.972351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-756fd90a-0c96-4239-95b3-c669672222b6 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.164210 Jul 18 16:48:44.972947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 493/984] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:44 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:45.007138 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:45.008121 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:45.015812 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.016390 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.017332 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.018545 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.187566 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:45.196726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-44202dc0-58bc-40e0-b88f-2e06c3b97cc8 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.193544 Jul 18 16:48:45.197374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 492/985] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:45 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:45.990950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:45.991559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:45.998665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.999242 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:46.000149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:46.000677 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:46.160546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:46.168459 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-99eea58f-4ad3-4649-861f-e498e6704b32 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.182158 Jul 18 16:48:46.169054 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 494/986] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:45 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:46.213595 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:46.214218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:46.221535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:46.222041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:46.222949 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:46.223432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:46.441661 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:46.453656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e994f3e9-45a3-4e74-9843-3b4873221ad5 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.244093 Jul 18 16:48:46.454380 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 493/987] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:46 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:47.186635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:47.187658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:47.197567 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.198256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.201604 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.202402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.370103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:47.381552 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-22ac904c-be5e-4b5a-bf2a-37a7e3808f4b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1359 microversion: 2.1 time: 0.198723 Jul 18 16:48:47.382399 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 495/988] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:47 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:47.472075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:47.472846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:47.480407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.480959 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.481966 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.482509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.678150 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:47.692480 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-26081076-4b9c-4109-9e7f-b910cb3a2101 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.224490 Jul 18 16:48:47.711305 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 494/989] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:47 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:48.407524 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.408627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:48.418764 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.419561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.421259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.421961 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.425123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a54cf46a-7bbf-4ffc-82c6-8a7699bf6392 req-70bd97d2-1b77-41ad-8bd3-c43eded38af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ff3d0-8b5c-4713-a1ab-d01d05162442", "name": "network-vif-plugged", "status": "completed", "tag": "bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:48.440896 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a54cf46a-7bbf-4ffc-82c6-8a7699bf6392 req-70bd97d2-1b77-41ad-8bd3-c43eded38af4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.441738 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a54cf46a-7bbf-4ffc-82c6-8a7699bf6392 req-70bd97d2-1b77-41ad-8bd3-c43eded38af4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.459204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a54cf46a-7bbf-4ffc-82c6-8a7699bf6392 req-70bd97d2-1b77-41ad-8bd3-c43eded38af4 service nova] Creating event network-vif-plugged:bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f for instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 on hv-cinder-83754 Jul 18 16:48:48.470553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-a54cf46a-7bbf-4ffc-82c6-8a7699bf6392 req-70bd97d2-1b77-41ad-8bd3-c43eded38af4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054051 Jul 18 16:48:48.472312 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 495/990] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:48.629971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.646134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-7004ec5f-7bf9-47aa-8687-d8474341ccb8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1548 microversion: 2.1 time: 0.242982 Jul 18 16:48:48.647504 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 496/991] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:48.665882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.666680 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:48.675262 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.675897 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.676692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.677117 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.718085 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.718730 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:48.725998 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.726496 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.727348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.727792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.855563 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.869485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-cd03712c-25b8-485c-8907-18403d9a4f1a tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1548 microversion: 2.1 time: 0.208468 Jul 18 16:48:48.870565 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 496/992] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:48.890561 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.898443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.899950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Searching by: {'deleted': False, 'project_id': '6343e3024ef0469da293401317da07f2'} {{(pid=129672) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 16:48:48.913248 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.914052 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.915634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.916432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.957811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.965482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9f645839-d151-4e89-9c69-00c8a8c6006d tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.251256 Jul 18 16:48:48.966076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 497/993] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:49.053548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.multi_cell_list [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129672) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 16:48:49.157726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c6f51594-51b8-4078-bb9b-0cc9fc3cb82f tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.275011 Jul 18 16:48:49.158939 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 497/994] 10.222.0.77 () {58 vars in 1124 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:49.171889 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:49.172842 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:49.179342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.179786 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.180562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.180993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.332006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:49.340006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0ce441bd-c8e4-4702-b24f-b8246ef59925 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1548 microversion: 2.1 time: 0.173923 Jul 18 16:48:49.340591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 498/995] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:49 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:49.985920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:49.987639 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:50.000029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.001669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.003681 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.004464 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.150268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:50.159145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b322c30f-8e03-4a95-831c-81f0b0fdfc3f tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1313 microversion: 2.1 time: 0.178843 Jul 18 16:48:50.159823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 498/996] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:49 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:50.961161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "affd9081-b7b4-4127-a04f-940d8e42b56c"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:50.962237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:50.976064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.976064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.976064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.976064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.077205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1553701201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1011843527", "security_groups": [{"name": "tempest-secgroup-smoke-977181763"}], "block_device_mapping_v2": [{"uuid": "f2e2c584-e4d9-4c13-a9a7-28380ee566bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94186e07-4092-42bb-bef4-09c745cebf42"}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:51.245972 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] validate_networks() for [('94186e07-4092-42bb-bef4-09c745cebf42', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:51.312535 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8cd8fa6f-297b-45a0-9769-d021d34dd618 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355201 Jul 18 16:48:51.313253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 499/997] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:48:50 2022] POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:51.326811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:51.328141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:51.335993 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.336750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.337691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.338456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.364632 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:51.530076 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:51.548257 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d6325cdf-c3b9-4211-83c6-dce6618424ec tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1463 microversion: 2.1 time: 0.225649 Jul 18 16:48:51.559847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 500/998] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:51 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:51.595328 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:51.599079 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:51.602928 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.604141 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.605330 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.605871 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.633766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:48:51.728611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0afd2b84-8895-4f6d-87c5-4122e001c15c tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "DELETE /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 204 len: 0 microversion: 2.1 time: 0.136958 Jul 18 16:48:51.729616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 501/999] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:48:51 2022] DELETE /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:48:51.741650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:51.742370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:51.749062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.749504 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.750291 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.750790 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.776096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:51.776787 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:51.777488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:51.777927 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:51.778644 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:51.793454 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.794719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.796467 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.797264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.829082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:51.837818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Getting quotas for user 6c7e0694c5ab46a4adef7a1f7b1fed4c and project edffd84b958d4e2a880fae7c4709d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:51.908709 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:51.912829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2e2c584-e4d9-4c13-a9a7-28380ee566bb',volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:51.937897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:51.947417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-36107bce-991c-4e3c-b0df-111dc1336833 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1469 microversion: 2.1 time: 0.211151 Jul 18 16:48:51.948008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 502/1000] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:51 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:52.104910 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0a72ff23-aec2-4d38-898d-9a92d7c92ab6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031430 Jul 18 16:48:52.108274 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 499/1001] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:48:52.119115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-29c9dd8e-8184-4948-ac29-319a688a2e0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:52.121174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-29c9dd8e-8184-4948-ac29-319a688a2e0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:52.206748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-29c9dd8e-8184-4948-ac29-319a688a2e0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:52.215778 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-29c9dd8e-8184-4948-ac29-319a688a2e0e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1095 microversion: 2.1 time: 0.101022 Jul 18 16:48:52.216751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 503/1002] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:52 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:52.974015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:52.974745 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:52.981922 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:52.982396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:52.983535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:52.984081 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:53.162578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:53.171235 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-875fdf23-213e-442a-a629-4da83dd6553b tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1469 microversion: 2.1 time: 0.202324 Jul 18 16:48:53.171997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 500/1003] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:52 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:53.233460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:53.234476 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:53.242588 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:53.243055 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:53.243836 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:53.244273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:53.316953 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:53.324566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-95cc30f1-3d95-45d2-a940-cfedd629c179 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1137 microversion: 2.1 time: 0.095451 Jul 18 16:48:53.325365 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 504/1004] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:53 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:54.190755 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:54.191373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:54.198190 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.198697 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.199468 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.199894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.355989 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:54.366613 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:54.378668 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.379508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.381297 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.383020 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.426592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a4e3980f4d4cc98a4be829b351315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f614b9264ed14eab9e67ee4fca9b922c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:54.447139 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-aba29bdc-4d78-4fb3-98a2-6eda089d8ffb tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 200 len: 1469 microversion: 2.1 time: 0.259609 Jul 18 16:48:54.447634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 501/1005] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:54 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:54.452756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-719e72c4-0f8b-4b4a-84a4-ec1a9c55fc90 req-a2f60cfd-9dbe-4d51-b39b-b0e3ab671805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ff3d0-8b5c-4713-a1ab-d01d05162442", "name": "network-vif-deleted", "tag": "bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:54.477366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-719e72c4-0f8b-4b4a-84a4-ec1a9c55fc90 req-a2f60cfd-9dbe-4d51-b39b-b0e3ab671805 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.478093 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-719e72c4-0f8b-4b4a-84a4-ec1a9c55fc90 req-a2f60cfd-9dbe-4d51-b39b-b0e3ab671805 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.493727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-719e72c4-0f8b-4b4a-84a4-ec1a9c55fc90 req-a2f60cfd-9dbe-4d51-b39b-b0e3ab671805 service nova] Creating event network-vif-deleted:bd2c91e0-cf2f-4fa3-adcb-23a0ccaa4a8f for instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 on hv-cinder-83754 Jul 18 16:48:54.500973 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-719e72c4-0f8b-4b4a-84a4-ec1a9c55fc90 req-a2f60cfd-9dbe-4d51-b39b-b0e3ab671805 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050896 Jul 18 16:48:54.502838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 502/1006] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:54.542374 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:54.557893 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-470f70c3-79c7-4850-adbf-eb4d572cf52e tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1211 microversion: 2.1 time: 0.215835 Jul 18 16:48:54.559617 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 505/1007] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:54 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1211 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:55.466503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:55.467908 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] [instance: 584ff3d0-8b5c-4713-a1ab-d01d05162442] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:55.476134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.476585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:55.477373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.477838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:55.493261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] HTTP exception thrown: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Request method failure captured: Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 HTTP/1.1 Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y7YOAElou6xMUKzo_ZVyDa2c_NtpMtkr5j70lyyssnCuBrH4EeeH9WcTx3fwLfdLPmN3-FNgr2SBfhNyFTAkLpHKN7B5OjF6NOgDwJ73Z7mp6U3XkrBr5EpY_ky8y53jlSsz8_RZ_1Lq5kozoXLrFtnlfp2tHTUbrWsLJbHHDrwB2U Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: f614b9264ed14eab9e67ee4fca9b922c Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-VolumesNegativeTest-1677999357 Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:48:55.494383 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/f614b9264ed14eab9e67ee4fca9b922c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_f614b9264ed14eab9e67ee4fca9b922c", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/f614b9264ed14eab9e67ee4fca9b922c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/f614b9264ed14eab9e67ee4fca9b922c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-VolumesNegativeTest-1677999357 Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: f614b9264ed14eab9e67ee4fca9b922c Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-VolumesNegativeTest-1677999357 Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-VolumesNegativeTest-1677999357-project Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 34a4e3980f4d4cc98a4be829b351315c Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-VolumesNegativeTest-1677999357-project Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. Jul 18 16:48:55.496357 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '584ff3d0-8b5c-4713-a1ab-d01d05162442'} Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:48:55.497756 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. Jul 18 16:48:55.500402 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:48:55.501578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] Returning 404 to user: Instance 584ff3d0-8b5c-4713-a1ab-d01d05162442 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:48:55.501578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0a0890d5-28a4-4af8-b2cd-d01f0f13c704 tempest-VolumesNegativeTest-1677999357 tempest-VolumesNegativeTest-1677999357-project] 10.222.0.77 "GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442" status: 404 len: 111 microversion: 2.1 time: 0.034497 Jul 18 16:48:55.501578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 503/1008] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:55 2022] GET /compute/v2.1/servers/584ff3d0-8b5c-4713-a1ab-d01d05162442 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:48:55.582290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:55.584272 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:55.608446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.609575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:55.614566 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.615676 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:56.031109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:56.052293 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-cf97b87c-18b3-4c54-9e5a-a8dd34764ce4 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1278 microversion: 2.1 time: 0.477624 Jul 18 16:48:56.053254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 506/1009] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:55 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1278 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:56.538968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-505a733a-7a51-461d-bf94-ef8f86d3810e req-51f2d8c0-8711-448a-a7f8-867b5edb9a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7f2b8a-2ed4-4428-ad01-d3d082a66797", "tag": "d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:56.551103 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-505a733a-7a51-461d-bf94-ef8f86d3810e req-51f2d8c0-8711-448a-a7f8-867b5edb9a67 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:56.551581 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-505a733a-7a51-461d-bf94-ef8f86d3810e req-51f2d8c0-8711-448a-a7f8-867b5edb9a67 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:56.565753 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-505a733a-7a51-461d-bf94-ef8f86d3810e req-51f2d8c0-8711-448a-a7f8-867b5edb9a67 service nova] Creating event network-changed:d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5 for instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 on hv-cinder-83754 Jul 18 16:48:56.571334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-505a733a-7a51-461d-bf94-ef8f86d3810e req-51f2d8c0-8711-448a-a7f8-867b5edb9a67 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037676 Jul 18 16:48:56.572501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 504/1010] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:57.075941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:57.077028 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:57.090983 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:57.091897 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:57.093990 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:57.095073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:57.345194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:57.356043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4ba80a58-f544-46b1-a354-100c5c7bc2d2 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1278 microversion: 2.1 time: 0.287695 Jul 18 16:48:57.357442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 507/1011] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:57 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1278 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:58.376987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:58.377727 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:58.384441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:58.384894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:58.385683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:58.386134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:58.401785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=100 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:58.544304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:58.553856 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-73e635e9-af9a-4dd2-b319-a21fbb341192 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1278 microversion: 2.1 time: 0.181428 Jul 18 16:48:58.554493 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 505/1012] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:58 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:59.571018 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:59.571662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:59.579233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:59.579718 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:59.580991 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:59.581442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:59.750264 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:59.759079 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c717519f-b2e3-436c-aa77-0a911794e688 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1278 microversion: 2.1 time: 0.191778 Jul 18 16:48:59.759691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 508/1013] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:59 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:00.309801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:00.309801 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:00.316440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.316901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.317699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.318137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.498445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:00.508973 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2c1c6fc2-f3b6-4a1c-98e0-8a6e99b9da73 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1594 microversion: 2.1 time: 0.209830 Jul 18 16:49:00.509765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 506/1014] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:00 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1594 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:00.787736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:00.789054 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:00.796952 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.797736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.798578 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.799154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.069096 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:01.071518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:01.085014 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.086195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.088618 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.090180 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.155802 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:01.159015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-81233ed8-cabc-47c2-8050-a11f8ccf5010 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100839 Jul 18 16:49:01.167857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 507/1015] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:49:01 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:49:01.168043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4adeb559-79e3-48c3-bef3-1fff4eaf8e79 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.382161 Jul 18 16:49:01.168043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 509/1016] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:00 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:01.300019 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:01.300556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:01.311953 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.313690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.314945 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.315412 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.357051 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Going to try to terminate instance {{(pid=129672) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:49:01.535037 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f1fd2440-f3e6-4c45-9870-b022cebbb497 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 204 len: 0 microversion: 2.1 time: 0.241574 Jul 18 16:49:01.536159 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 508/1017] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:49:01 2022] DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:49:01.551039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:01.552562 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:01.563741 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.565079 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.566922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.568025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.907382 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:01.918346 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4ad2c4d2-c866-4349-8460-d4052cea3b14 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1673 microversion: 2.1 time: 0.375569 Jul 18 16:49:01.919663 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 510/1018] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:01 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1673 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:02.190666 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:02.191562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:02.194095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:02.195508 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=6 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:02.203850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.204369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:02.206017 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.206645 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:02.399349 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:02.407893 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e10dd64e-0621-4b89-998c-59cfb3dc7838 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.222915 Jul 18 16:49:02.408602 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 509/1019] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:02 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:02.944771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:02.945793 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:02.949673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:02.960870 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.961684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:02.963124 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.963859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:03.437674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:03.438852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:03.452514 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:03.453413 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:03.455752 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:03.456592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:03.503514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:03.518451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b4e55342-c29e-474d-ab47-ef846eebd7c8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1673 microversion: 2.1 time: 0.579456 Jul 18 16:49:03.520151 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 511/1020] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:02 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1673 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:03.724497 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:03.739553 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d6080056-8d5f-4ff0-9ef5-6071f6dd1f07 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.309445 Jul 18 16:49:03.741213 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 510/1021] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:03 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:03.871957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-f57f9540-b5b0-43af-bdf1-1c3aa7aea6c0 req-acbf5ba6-e7ac-4a00-b45e-65666102aef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:03.901507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f57f9540-b5b0-43af-bdf1-1c3aa7aea6c0 req-acbf5ba6-e7ac-4a00-b45e-65666102aef3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:03.902214 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-f57f9540-b5b0-43af-bdf1-1c3aa7aea6c0 req-acbf5ba6-e7ac-4a00-b45e-65666102aef3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:03.954743 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-f57f9540-b5b0-43af-bdf1-1c3aa7aea6c0 req-acbf5ba6-e7ac-4a00-b45e-65666102aef3 service nova] Creating event network-changed:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:49:03.983958 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-f57f9540-b5b0-43af-bdf1-1c3aa7aea6c0 req-acbf5ba6-e7ac-4a00-b45e-65666102aef3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143530 Jul 18 16:49:03.985858 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 512/1022] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:04.546295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:04.548016 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:04.564855 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:04.566376 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:04.567417 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:04.569945 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:04.762898 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:04.763912 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:04.771711 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:04.772457 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:04.773415 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:04.774010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:05.089335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:05.122224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-348a7c7c-af55-4454-82a9-c811e2f1ae76 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1673 microversion: 2.1 time: 0.583785 Jul 18 16:49:05.124673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 511/1023] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:04 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1673 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:05.203324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:05.235104 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d5ff6c10-592a-4377-a037-fa66aa59a8ed tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.475165 Jul 18 16:49:05.237705 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 513/1024] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:04 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:06.087097 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-20296189-de91-434c-8597-25cdc803f6bb req-43e40f5a-d68e-45c0-8101-abcf06de5465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb2c5ba-19c9-4812-9da4-a074d69d56f4", "name": "network-vif-deleted", "tag": "dd9ce4d7-eac9-49bf-a75b-895d5cdce0df"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:06.108122 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-20296189-de91-434c-8597-25cdc803f6bb req-43e40f5a-d68e-45c0-8101-abcf06de5465 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.109283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-20296189-de91-434c-8597-25cdc803f6bb req-43e40f5a-d68e-45c0-8101-abcf06de5465 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.138524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-20296189-de91-434c-8597-25cdc803f6bb req-43e40f5a-d68e-45c0-8101-abcf06de5465 service nova] Creating event network-vif-deleted:dd9ce4d7-eac9-49bf-a75b-895d5cdce0df for instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 on hv-cinder-83754 Jul 18 16:49:06.154359 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:06.157452 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:06.166366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-20296189-de91-434c-8597-25cdc803f6bb req-43e40f5a-d68e-45c0-8101-abcf06de5465 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086721 Jul 18 16:49:06.169702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:06.172444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 512/1025] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:06.177322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.178047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.179179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.179751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.260915 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:06.262331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:06.284340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.285805 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.288212 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.290556 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.340008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:06.360698 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-99576213-37d6-430a-932e-c68f4d8e98a3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1606 microversion: 2.1 time: 0.213657 Jul 18 16:49:06.362854 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 514/1026] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:06 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1606 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:06.573828 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1717151594"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:06.574607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:06.582155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.582837 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.583763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.584200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.586104 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:06.603786 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-447ce333-9c60-44a1-87d3-700a3b4ad455 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.353586 Jul 18 16:49:06.605218 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 513/1027] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:06 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:06.772828 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.network.security_group_api [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Adding security group 09e9c477-f43e-48a7-890e-59339fe5aca6 to port 19805b70-1ef7-4076-a283-63a2ef8e869f Jul 18 16:49:07.288368 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6e6b96bb-e408-421f-83ee-53614a3149ec tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action" status: 202 len: 0 microversion: 2.1 time: 0.717021 Jul 18 16:49:07.290641 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 515/1028] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:49:06 2022] POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:49:07.306124 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:07.306922 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:07.327973 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.340503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.342118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.343168 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.395662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:07.407122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:07.427276 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.431478 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.433434 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.436300 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.487735 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.488925 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.490128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lazy-loading 'fault' on Instance uuid 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:49:07.588003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:07.612792 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d8fdb685-6f29-4581-bfbb-70be3e03b297 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 200 len: 1326 microversion: 2.1 time: 0.232798 Jul 18 16:49:07.613810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 516/1029] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:07 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 1326 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:07.637240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:07.638350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:07.671387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.672109 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.673353 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.683595 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.701733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:07.781330 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:07.806231 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-85a28c64-5a92-4a07-a16d-8af8ef0798dd tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1759 microversion: 2.1 time: 0.508409 Jul 18 16:49:07.807651 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 514/1030] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:07 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1759 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:07.932585 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:07.941823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c4791edb-79c2-4eed-8508-9b27cd5f987c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.318236 Jul 18 16:49:07.942950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 517/1031] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:07 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:08.201596 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-a014c920-45fc-4d91-96d8-6b2d335e65df req-c89ecbf7-e58d-42e9-9303-92a3ca676c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:08.206613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:08.214438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a014c920-45fc-4d91-96d8-6b2d335e65df req-c89ecbf7-e58d-42e9-9303-92a3ca676c0a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.215053 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-a014c920-45fc-4d91-96d8-6b2d335e65df req-c89ecbf7-e58d-42e9-9303-92a3ca676c0a service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.231419 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-a014c920-45fc-4d91-96d8-6b2d335e65df req-c89ecbf7-e58d-42e9-9303-92a3ca676c0a service nova] Creating event network-changed:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:49:08.238353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-a014c920-45fc-4d91-96d8-6b2d335e65df req-c89ecbf7-e58d-42e9-9303-92a3ca676c0a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041137 Jul 18 16:49:08.239038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 515/1032] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:08.644131 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:08.645976 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:08.661507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.662316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.663722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.664502 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.695296 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 HTTP/1.1 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:49:08.698234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:49:08.700942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '2bb2c5ba-19c9-4812-9da4-a074d69d56f4'} Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:08.702550 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:49:08.705783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:49:08.708445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:08.708445 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-40fbb150-693a-4aa1-909e-cd00fb51f9d4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 404 len: 111 microversion: 2.1 time: 0.066646 Jul 18 16:49:08.710899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 518/1033] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:08 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:49:08.717734 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6212a37a-40b5-4267-9222-5d54063204d7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '.version_select at 0x7fc3a27e6700>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:08.742238 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6212a37a-40b5-4267-9222-5d54063204d7 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901129643" status: 202 len: 0 microversion: 2.1 time: 0.029251 Jul 18 16:49:08.743578 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 516/1034] 10.222.0.77 () {58 vars in 1217 bytes} [Mon Jul 18 16:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901129643 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:49:08.962638 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:08.963555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:08.975305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.976048 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.977298 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.978022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.180802 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:09.195671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-de76f07d-578c-4b97-ab96-674abf3f07aa tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.238124 Jul 18 16:49:09.197160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 519/1035] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:08 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:09.634518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-8b5f6eaa-8a64-4da7-97e8-db8f0424699d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: .version_select at 0x7fc3a28c09d0>, body: {"keypair": {"name": "tempest-keypair-1393160485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC342S1bJuW7O6oDrSKefMfh7iMkVTfv0FpeAEISYZeEBZsUw2rPRvGXXuBaTz2fTlihNY8tL2uIUaCtrBCWwS3LGZ+ammVV6cNA82iy9kWu/qubpdPykbvC7ld4dIFBxA=="}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:09.650835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-8b5f6eaa-8a64-4da7-97e8-db8f0424699d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for project 628c00a1a5df481982b083fa3c447be2. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:49:09.654845 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-8b5f6eaa-8a64-4da7-97e8-db8f0424699d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for user d66dde93e0f14ce799c9c6294f216781 and project 628c00a1a5df481982b083fa3c447be2. Resources: {'key_pairs'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:49:09.678188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-8b5f6eaa-8a64-4da7-97e8-db8f0424699d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047572 Jul 18 16:49:09.678842 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 517/1036] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:49:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:49:10.224344 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:10.225593 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:10.237126 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.238030 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.239466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.240243 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.546071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-c9f8463d-0258-43e9-bb37-2c6cd939f0ec req-a9fcbd79-dd6e-40d2-b016-37f6c89369f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7f2b8a-2ed4-4428-ad01-d3d082a66797", "name": "network-vif-plugged", "status": "completed", "tag": "d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:10.566396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-c9f8463d-0258-43e9-bb37-2c6cd939f0ec req-a9fcbd79-dd6e-40d2-b016-37f6c89369f8 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.567870 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-c9f8463d-0258-43e9-bb37-2c6cd939f0ec req-a9fcbd79-dd6e-40d2-b016-37f6c89369f8 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.587348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-c9f8463d-0258-43e9-bb37-2c6cd939f0ec req-a9fcbd79-dd6e-40d2-b016-37f6c89369f8 service nova] Creating event network-vif-plugged:d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5 for instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 on hv-cinder-83754 Jul 18 16:49:10.597022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-c9f8463d-0258-43e9-bb37-2c6cd939f0ec req-a9fcbd79-dd6e-40d2-b016-37f6c89369f8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058144 Jul 18 16:49:10.598952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 518/1037] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:10.811660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:10.827194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5bcdb8de-d474-46c5-97d8-a5d5ea518f15 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.609533 Jul 18 16:49:10.829668 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 520/1038] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:10 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:11.665998 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-898808121", "imageRef": "556d72b1-5a8d-41d6-b634-0b7dac16ff32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98c424f3-63a6-4074-a1da-b047ae66c92b"}], "security_groups": [{"name": "tempest-securitygroup--1089914866"}], "key_name": "tempest-keypair-1393160485", "user_data": "}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:11.803041 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] validate_networks() for [('98c424f3-63a6-4074-a1da-b047ae66c92b', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:49:11.853390 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:11.854375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:11.862381 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:11.863227 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:11.864075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:11.864686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.049442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:12.062240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-20cb2d35-723d-4702-ab73-96bbb4d20713 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1266 microversion: 2.1 time: 0.212840 Jul 18 16:49:12.073556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 521/1039] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:11 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:12.283008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:49:12.283598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:49:12.284272 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:49:12.284749 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:49:12.285296 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:49:12.296916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.297445 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.298119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.299293 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.320026 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for project 628c00a1a5df481982b083fa3c447be2. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:49:12.325460 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Getting quotas for user d66dde93e0f14ce799c9c6294f216781 and project 628c00a1a5df481982b083fa3c447be2. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:49:12.343056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:49:12.346364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='556d72b1-5a8d-41d6-b634-0b7dac16ff32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:49:12.401134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-787cee37-bb90-448c-8182-c88ed1e22366 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.744366 Jul 18 16:49:12.406970 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 519/1040] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:49:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:49:12.414116 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-30156c27-49ab-4fea-b433-72725d81ac05 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:12.415114 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-30156c27-49ab-4fea-b433-72725d81ac05 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:12.489101 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-30156c27-49ab-4fea-b433-72725d81ac05 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:12.500662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-30156c27-49ab-4fea-b433-72725d81ac05 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1237 microversion: 2.1 time: 0.090706 Jul 18 16:49:12.501722 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 522/1041] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:12 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:13.092418 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:13.093364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:13.107258 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.108071 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.109479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.109991 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.296046 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:13.305203 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-46b50b95-9ec1-442e-bbc1-eae1b60c91f9 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1453 microversion: 2.1 time: 0.220261 Jul 18 16:49:13.305811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 520/1042] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:13 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:13.322709 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:13.323336 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:13.331587 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.332044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.332839 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.333352 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.499350 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:13.509303 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-1dc342d9-6e70-40e3-9d77-56cfaf783765 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1453 microversion: 2.1 time: 0.190468 Jul 18 16:49:13.510068 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 523/1043] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:13 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:13.533584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:13.534807 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:13.544451 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.545165 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.546626 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:13.547524 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.674603 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:13.689980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3c1d916f-fc9e-4a49-be96-5e7bc1300563 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1297 microversion: 2.1 time: 0.164093 Jul 18 16:49:13.691331 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 521/1044] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:13 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:14.736253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:14.741932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:14.780749 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:14.781904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:14.785083 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:14.786200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:15.120180 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:15.132526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-bf846c7c-7143-4f82-a339-989c792c38f3 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.421495 Jul 18 16:49:15.133710 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 524/1045] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:14 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:15.906976 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-b33cfb29-f221-49aa-9bab-f06f53ca6890 req-8c0f781d-3e3c-4a10-bd6a-eef876259552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d354e15b-fcbf-4c9b-b379-d5644fd77b06", "tag": "331e9656-e8ae-4723-897f-e7a26127e403"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:15.958967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b33cfb29-f221-49aa-9bab-f06f53ca6890 req-8c0f781d-3e3c-4a10-bd6a-eef876259552 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:15.959682 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b33cfb29-f221-49aa-9bab-f06f53ca6890 req-8c0f781d-3e3c-4a10-bd6a-eef876259552 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:16.000894 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-b33cfb29-f221-49aa-9bab-f06f53ca6890 req-8c0f781d-3e3c-4a10-bd6a-eef876259552 service nova] Creating event network-changed:331e9656-e8ae-4723-897f-e7a26127e403 for instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 on hv-cinder-83754 Jul 18 16:49:16.012916 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-b33cfb29-f221-49aa-9bab-f06f53ca6890 req-8c0f781d-3e3c-4a10-bd6a-eef876259552 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112840 Jul 18 16:49:16.015142 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 522/1046] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:16.168025 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:16.169386 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:16.187228 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:16.188194 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:16.190223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:16.191010 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:16.454997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-af61d522-96a6-4ecb-8e5f-cc20666f294f req-fbde83af-8a29-4cd5-9ff1-f84e6ca4f049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7f2b8a-2ed4-4428-ad01-d3d082a66797", "tag": "d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:16.473453 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-af61d522-96a6-4ecb-8e5f-cc20666f294f req-fbde83af-8a29-4cd5-9ff1-f84e6ca4f049 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:16.475196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-af61d522-96a6-4ecb-8e5f-cc20666f294f req-fbde83af-8a29-4cd5-9ff1-f84e6ca4f049 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:16.498373 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-af61d522-96a6-4ecb-8e5f-cc20666f294f req-fbde83af-8a29-4cd5-9ff1-f84e6ca4f049 service nova] Creating event network-changed:d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5 for instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 on hv-cinder-83754 Jul 18 16:49:16.509535 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-af61d522-96a6-4ecb-8e5f-cc20666f294f req-fbde83af-8a29-4cd5-9ff1-f84e6ca4f049 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063465 Jul 18 16:49:16.510628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 523/1047] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:49:16.516153 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:16.538514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0a2b24f6-c5f9-4144-ae63-269d94bf24a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.381713 Jul 18 16:49:16.539679 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 525/1048] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:16 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:17.566733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:17.567703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:17.574444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:17.574914 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:17.575710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:17.576149 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:17.831284 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:17.840086 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5974b999-e639-4c42-8ac9-74d33dc70cf9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.278156 Jul 18 16:49:17.850396 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 524/1049] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:17 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:18.858485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:18.861467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:18.883594 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:18.884165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:18.885008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:18.885611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:19.039322 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:19.047729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-44795ddb-9491-48b9-a330-58362cf1aa20 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.193459 Jul 18 16:49:19.048323 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 526/1050] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:18 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:20.066692 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:20.067353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:20.074770 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:20.075221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:20.076013 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:20.076446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:20.237330 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:20.245170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-10285b8d-5983-4a3e-a050-ee997a6e001a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.182584 Jul 18 16:49:20.245829 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 525/1051] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:20 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:20.554175 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-7117cde8-16a6-49b4-aab6-daeee9de902d req-938df474-813d-4fbf-97f5-3b676a72d867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d354e15b-fcbf-4c9b-b379-d5644fd77b06", "name": "network-vif-plugged", "status": "completed", "tag": "331e9656-e8ae-4723-897f-e7a26127e403"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:20.570149 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7117cde8-16a6-49b4-aab6-daeee9de902d req-938df474-813d-4fbf-97f5-3b676a72d867 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:20.570835 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-7117cde8-16a6-49b4-aab6-daeee9de902d req-938df474-813d-4fbf-97f5-3b676a72d867 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:20.590686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-7117cde8-16a6-49b4-aab6-daeee9de902d req-938df474-813d-4fbf-97f5-3b676a72d867 service nova] Creating event network-vif-plugged:331e9656-e8ae-4723-897f-e7a26127e403 for instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 on hv-cinder-83754 Jul 18 16:49:20.599904 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-7117cde8-16a6-49b4-aab6-daeee9de902d req-938df474-813d-4fbf-97f5-3b676a72d867 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053513 Jul 18 16:49:20.600735 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 527/1052] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:49:21.262427 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:21.263181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:21.270574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:21.271056 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:21.271838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:21.272271 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:21.289539 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:21.428967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:21.437116 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-9d43e903-34ff-4761-957f-d7824fb6c41c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.178480 Jul 18 16:49:21.437772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 526/1053] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:21 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:22.459449 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:22.460783 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:22.472334 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:22.472962 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:22.474077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:22.474719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:22.495403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:22.675222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:22.686884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c1249851-51f1-4bb2-95c6-bacff15657cd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1363 microversion: 2.1 time: 0.234984 Jul 18 16:49:22.687686 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 528/1054] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:22 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:23.715158 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:23.715803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:23.718249 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:23.718968 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=10 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:23.725798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:23.726246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:23.727067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:23.727531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:23.892785 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:23.902487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3f2a4a40-9bf9-4fdb-ac19-d44856d252f6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1549 microversion: 2.1 time: 0.191074 Jul 18 16:49:23.903007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 527/1055] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:23 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:23.926493 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:23.927378 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:23.934908 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:23.935355 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:23.936143 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:23.936576 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:24.030075 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a2597265-17b6-4376-b31f-1d119b1544cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107925 Jul 18 16:49:24.030918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 529/1056] 10.222.0.77 () {58 vars in 1274 bytes} [Mon Jul 18 16:49:23 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:25.153171 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-59236ca2-8bcd-49c2-a4ab-63323dd68cbf req-d07dfff7-6f8b-4e46-b138-ea868d472b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d354e15b-fcbf-4c9b-b379-d5644fd77b06", "tag": "331e9656-e8ae-4723-897f-e7a26127e403"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:25.166853 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-59236ca2-8bcd-49c2-a4ab-63323dd68cbf req-d07dfff7-6f8b-4e46-b138-ea868d472b93 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:25.167544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-59236ca2-8bcd-49c2-a4ab-63323dd68cbf req-d07dfff7-6f8b-4e46-b138-ea868d472b93 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:25.183964 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-59236ca2-8bcd-49c2-a4ab-63323dd68cbf req-d07dfff7-6f8b-4e46-b138-ea868d472b93 service nova] Creating event network-changed:331e9656-e8ae-4723-897f-e7a26127e403 for instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 on hv-cinder-83754 Jul 18 16:49:25.191624 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-59236ca2-8bcd-49c2-a4ab-63323dd68cbf req-d07dfff7-6f8b-4e46-b138-ea868d472b93 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042600 Jul 18 16:49:25.192719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 528/1057] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:49:30.392985 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:30.394155 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:30.400946 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:30.401449 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:30.402301 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:30.402868 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:30.488619 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-77829e78-6691-41ed-a445-b9c53c4aa044 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action" status: 202 len: 0 microversion: 2.1 time: 0.100487 Jul 18 16:49:30.489354 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 530/1058] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:49:30 2022] POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:49:30.498941 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:30.499817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:30.509811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:30.511002 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:30.514011 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:30.515489 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:30.842629 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:30.857672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-af0d072c-0a22-42cd-9a2e-3756490c269e tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1751 microversion: 2.1 time: 0.363188 Jul 18 16:49:30.873253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 529/1059] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:30 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1751 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:31.887426 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:31.888432 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:31.896060 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:31.896555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:31.897471 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:31.897949 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:32.122977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:32.132349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0eb9b8f9-6470-4627-ab4a-1cb3c66a580b tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.250042 Jul 18 16:49:32.132951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 531/1060] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:31 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:33.151184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:33.151800 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:33.159327 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:33.159781 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:33.160555 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:33.160980 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:33.331269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:33.340229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a82b4f61-040a-4ca8-a41f-faf5004b4087 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.192844 Jul 18 16:49:33.340906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 530/1061] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:33 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:34.358691 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:34.359309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:34.367907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:34.368370 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:34.369170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:34.369615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:34.532176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:34.542458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-13df7b2e-4f72-4cac-aeff-9a26f9685b98 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.187473 Jul 18 16:49:34.543379 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 532/1062] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:34 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:35.560698 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:35.561346 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:35.570211 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:35.570705 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:35.571491 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:35.571954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:35.754302 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:35.762657 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-72921b1e-24cd-4767-9e00-9f32c4a8aaf2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.205940 Jul 18 16:49:35.763239 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 531/1063] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:35 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:36.788187 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:36.788810 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:36.791260 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=42 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:36.796836 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:36.797278 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:36.798039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:36.798483 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:36.954127 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:36.969491 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c44056b2-f27a-4e60-b6f1-4b79b0662f90 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.184870 Jul 18 16:49:36.970736 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 533/1064] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:36 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:37.987860 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:37.988516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:37.995674 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:37.996164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:37.996971 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:37.997407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:38.206483 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:38.215311 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3c2e5487-b95d-4606-bf55-dfb871769e16 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.231336 Jul 18 16:49:38.215909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 532/1065] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:37 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:39.233006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:39.233723 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:39.240808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:39.241254 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:39.242052 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:39.242518 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:39.246531 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:39.415451 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:39.424665 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2f17384a-b1aa-46f7-89da-f38ef7ecacad tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.195596 Jul 18 16:49:39.425264 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 534/1066] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:39 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:40.443162 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:40.443929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:40.446932 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:40.453205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:40.453747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:40.454707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:40.455178 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:40.624422 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:40.639246 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6d130bfd-f068-4ea6-92b9-4bab37657f19 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.199990 Jul 18 16:49:40.640319 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 533/1067] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:40 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:41.658115 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:41.658797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:41.665706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:41.666160 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:41.666980 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:41.667421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:41.834128 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:41.843685 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6749da69-b836-4f9d-b632-ea4ee3684666 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1756 microversion: 2.1 time: 0.189345 Jul 18 16:49:41.844363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 535/1068] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:41 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:42.863151 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:42.863940 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:42.872270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:42.872747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:42.873701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:42.874148 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:43.037783 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:43.046669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-821a61b2-acec-49fa-bbd9-7f01631b9802 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1759 microversion: 2.1 time: 0.188314 Jul 18 16:49:43.047262 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 534/1069] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:42 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:01.341519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:01.342166 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:01.344907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=5 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.345556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=11 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.352256 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:01.352724 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:01.353564 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:01.354017 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:01.534702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-df799efe-818f-4b08-87a4-ddf4110e0d0a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/ips" status: 200 len: 145 microversion: 2.1 time: 0.197034 Jul 18 16:50:01.535265 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 536/1070] 10.222.0.77 () {58 vars in 1247 bytes} [Mon Jul 18 16:50:01 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/ips => generated 145 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:02.965260 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5e68f2-85ea-4fad-986e-828e3a6ea565"}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:02.966531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:02.968835 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:02.969531 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=47 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:02.975950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:02.976418 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:02.977348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:02.977832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:03.300440 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-12f6d65e-9472-48d7-9fe5-a83c548531c4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339254 Jul 18 16:50:03.301522 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 535/1071] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:50:02 2022] POST /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:10.917289 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:10.918371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:10.926603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:10.927093 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:10.927922 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:10.928393 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:10.962286 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-25343840-df4f-43cf-8e4b-33605cb4e326 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049812 Jul 18 16:50:10.962919 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 537/1072] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:10 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:10.977488 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:10.978155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:10.984760 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:10.985205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:10.985984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:10.986472 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:11.024479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7ac3d314-e6e0-4b00-95ec-074021fea266 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565" status: 200 len: 194 microversion: 2.1 time: 0.051775 Jul 18 16:50:11.025322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 536/1073] 10.222.0.77 () {58 vars in 1412 bytes} [Mon Jul 18 16:50:10 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:12.415771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d364ad3-a8e3-4b84-bd3d-6649d759ae1c"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:12.417795 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:12.431176 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:12.432047 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:12.433590 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:12.434470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:12.782751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-872be7fb-c8c8-4738-a20e-3820550e15a6 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "POST /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373948 Jul 18 16:50:12.783934 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 538/1074] 10.222.0.77 () {60 vars in 1322 bytes} [Mon Jul 18 16:50:12 2022] POST /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:20.398182 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:20.399181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:20.406306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.406794 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.407574 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.407997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.442269 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ddd2811d-fde2-40ac-b6a4-d8c73a88fe68 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048355 Jul 18 16:50:20.442886 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 537/1075] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:20 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:50:20.598933 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:20.599516 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:20.607003 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.607454 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.608253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.608694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.643529 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-543bec16-74ca-4e08-81e3-f1229fe7375a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565" status: 200 len: 194 microversion: 2.1 time: 0.049433 Jul 18 16:50:20.644492 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 539/1076] 10.222.0.77 () {58 vars in 1412 bytes} [Mon Jul 18 16:50:20 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:20.657108 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:20.657653 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:20.665164 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.665673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.666589 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:20.667101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:20.767324 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lazy-loading 'services' on Instance uuid d354e15b-fcbf-4c9b-b379-d5644fd77b06 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:50:20.851001 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-625b9914-7b0c-44c8-956d-731e87c0023a tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565" status: 202 len: 0 microversion: 2.1 time: 0.198024 Jul 18 16:50:20.851861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 538/1077] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:50:20 2022] DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/6f5e68f2-85ea-4fad-986e-828e3a6ea565 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:21.588781 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1717151594"}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:21.589328 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:21.596906 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.597391 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.598461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.598886 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.782253 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.network.security_group_api [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Removing security group 09e9c477-f43e-48a7-890e-59339fe5aca6 from port 19805b70-1ef7-4076-a283-63a2ef8e869f Jul 18 16:50:22.228509 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e49182b7-4757-4420-be06-84daef76ccf5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action" status: 202 len: 0 microversion: 2.1 time: 0.643611 Jul 18 16:50:22.229327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 540/1078] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:50:21 2022] POST /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:22.389283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-24e4c54f-faa8-4cee-8512-7d65d62ecafd req-0bed7a1d-351b-455f-80b8-909f56a16802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:22.410304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-24e4c54f-faa8-4cee-8512-7d65d62ecafd req-0bed7a1d-351b-455f-80b8-909f56a16802 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:22.411367 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-24e4c54f-faa8-4cee-8512-7d65d62ecafd req-0bed7a1d-351b-455f-80b8-909f56a16802 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:22.435240 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-24e4c54f-faa8-4cee-8512-7d65d62ecafd req-0bed7a1d-351b-455f-80b8-909f56a16802 service nova] Creating event network-changed:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:50:22.448431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-24e4c54f-faa8-4cee-8512-7d65d62ecafd req-0bed7a1d-351b-455f-80b8-909f56a16802 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197037 Jul 18 16:50:22.450600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 539/1079] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:23.087241 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:23.088586 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:23.096729 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.097387 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.098289 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.098827 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.140094 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-36cb7395-9e3b-4173-b7c2-21ba29b0089e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/7d364ad3-a8e3-4b84-bd3d-6649d759ae1c" status: 200 len: 194 microversion: 2.1 time: 0.058659 Jul 18 16:50:23.140731 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 541/1080] 10.222.0.77 () {58 vars in 1412 bytes} [Mon Jul 18 16:50:23 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/7d364ad3-a8e3-4b84-bd3d-6649d759ae1c => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:23.152925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:23.153722 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:23.160701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.161484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.162282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.162744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.255509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.objects.instance [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lazy-loading 'services' on Instance uuid d354e15b-fcbf-4c9b-b379-d5644fd77b06 {{(pid=129672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:50:23.340912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-208e11b5-c146-4230-adc7-1b8be076abc9 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/7d364ad3-a8e3-4b84-bd3d-6649d759ae1c" status: 202 len: 0 microversion: 2.1 time: 0.192847 Jul 18 16:50:23.341706 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 540/1081] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:50:23 2022] DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments/7d364ad3-a8e3-4b84-bd3d-6649d759ae1c => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:23.900570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:23.901580 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:23.914375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.916479 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.919111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.921449 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.064742 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lazy-loading 'services' on Instance uuid a2cad856-84f7-41b3-b0b2-95af46ae309f {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:50:24.182302 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c4daeeb0-3527-40eb-9d54-df2a05b00d4c tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments/affd9081-b7b4-4127-a04f-940d8e42b56c" status: 202 len: 0 microversion: 2.1 time: 0.287834 Jul 18 16:50:24.183528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 542/1082] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:50:23 2022] DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments/affd9081-b7b4-4127-a04f-940d8e42b56c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:24.192810 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:24.193877 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:24.200750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.201599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.202587 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.203279 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.238374 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-44ed2d2a-fb5a-45fe-8739-9b8627dc9975 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049998 Jul 18 16:50:24.243295 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 541/1083] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:24 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:50:24.470294 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-b993f392-d35d-42ed-8b22-24032d215770 req-7cd1c798-6f5b-4183-93ff-0d13a78d57de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:24.480095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-b993f392-d35d-42ed-8b22-24032d215770 req-7cd1c798-6f5b-4183-93ff-0d13a78d57de service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.480787 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-b993f392-d35d-42ed-8b22-24032d215770 req-7cd1c798-6f5b-4183-93ff-0d13a78d57de service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.493570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-b993f392-d35d-42ed-8b22-24032d215770 req-7cd1c798-6f5b-4183-93ff-0d13a78d57de service nova] Creating event network-changed:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:50:24.499292 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-b993f392-d35d-42ed-8b22-24032d215770 req-7cd1c798-6f5b-4183-93ff-0d13a78d57de service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033430 Jul 18 16:50:24.499678 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 543/1084] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:24.569219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:24.570437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:24.577882 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.578321 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.579954 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.580388 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.626918 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dd18901a-222f-4d70-b678-0089a05c8bb8 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062400 Jul 18 16:50:24.627503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 542/1085] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:24 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:50:25.259678 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.261489 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.272977 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.273773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.275231 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.276037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.342467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0e9b5110-c567-40ea-9660-8c58f6e71cdf tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093022 Jul 18 16:50:25.343514 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 544/1086] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:50:25.362080 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.363925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.375179 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.376029 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.377353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.378088 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.464920 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] HTTP exception thrown: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f is not attached to volume affd9081-b7b4-4127-a04f-940d8e42b56c Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Request method failure captured: Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments/affd9081-b7b4-4127-a04f-940d8e42b56c HTTP/1.1 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y7ABFSmA8HETc7mSNJtalgjvJAGvwvXLjBJaCVOJMj8h4ZZ7MEdOQ43ApouAeccBBt9-zFtchRkl7BReTUocLaS1Go-t4rALy6GOmxEGuLQ1za990xmfiBBoPWMcY1lWv-v3tKKaZw11VNdi61HgUQObzEH9LxwXDOK_a3J0snpqQM Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 6343e3024ef0469da293401317da07f2 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:50:25.467474 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/6343e3024ef0469da293401317da07f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_6343e3024ef0469da293401317da07f2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/6343e3024ef0469da293401317da07f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/6343e3024ef0469da293401317da07f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 6343e3024ef0469da293401317da07f2 Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestMinimumBasicScenario-2102841788-project Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: b54a5070a23e45a3975c0fa0f2bcc76e Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestMinimumBasicScenario-2102841788-project Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:50:25.474253 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f is not attached to volume affd9081-b7b4-4127-a04f-940d8e42b56c Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'server_id': 'a2cad856-84f7-41b3-b0b2-95af46ae309f', 'id': 'affd9081-b7b4-4127-a04f-940d8e42b56c'} Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id affd9081-b7b4-4127-a04f-940d8e42b56c. Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:25.475221 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f is not attached to volume affd9081-b7b4-4127-a04f-940d8e42b56c Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f is not attached to volume affd9081-b7b4-4127-a04f-940d8e42b56c Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:25.476950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Returning 404 to user: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f is not attached to volume affd9081-b7b4-4127-a04f-940d8e42b56c {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:25.479268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e58cf6fc-8a88-4f24-b950-610ee1dd10d8 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments/affd9081-b7b4-4127-a04f-940d8e42b56c" status: 404 len: 154 microversion: 2.1 time: 0.115565 Jul 18 16:50:25.479268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 543/1087] 10.222.0.77 () {58 vars in 1415 bytes} [Mon Jul 18 16:50:25 2022] DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f/os-volume_attachments/affd9081-b7b4-4127-a04f-940d8e42b56c => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:25.639216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.640144 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.650190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.651006 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.652400 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.653215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.689882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-362c63bc-192b-48b2-9895-8c0755d8f900 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054584 Jul 18 16:50:25.690669 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 545/1088] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:50:25.844104 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.846441 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.858328 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.859193 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.860462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.862381 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.908675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-d022767f-8b0f-411c-bb0b-5011b0fc5f3c tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070333 Jul 18 16:50:25.909270 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 544/1089] 10.222.0.77 () {58 vars in 1301 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:50:25.973057 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.973559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.979820 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.980263 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.981067 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.981499 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.008154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:50:26.097694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8222f91b-bb9f-495b-8aec-1a7250eee871 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 204 len: 0 microversion: 2.1 time: 0.128892 Jul 18 16:50:26.098658 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 546/1090] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:50:25 2022] DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:50:26.108594 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.109214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.115747 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.116209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.116994 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.117446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.269434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:26.277532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-0b650855-06e0-48a4-92cb-e816a333980f tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1673 microversion: 2.1 time: 0.174045 Jul 18 16:50:26.278170 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 545/1091] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:26 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:26.629000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.629717 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.637164 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.637607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.638385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.638849 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.667852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:50:26.767635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-e0208ec5-b48a-4866-9563-b10ff80fc6c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 204 len: 0 microversion: 2.1 time: 0.143404 Jul 18 16:50:26.768363 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 547/1092] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:50:26 2022] DELETE /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:50:26.778370 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.779025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.786227 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.786719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.787547 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.787984 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.950386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:26.959663 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3c91c6d8-18e4-4d0a-8b89-77d0240572b2 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1554 microversion: 2.1 time: 0.186042 Jul 18 16:50:26.960430 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 546/1093] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:26 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:27.362259 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:27.363548 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:27.374178 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.374981 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.377123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.416650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:27.554971 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:27.563700 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-502961ab-2242-464c-9736-62ff0ae5e6fd tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1673 microversion: 2.1 time: 0.270991 Jul 18 16:50:27.564302 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 548/1094] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:27 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:27.979342 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:27.979997 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:27.987510 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.987961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.988744 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.989183 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.142055 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:28.154057 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-10e2f10a-812d-4698-9d80-f990bc093772 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1554 microversion: 2.1 time: 0.178815 Jul 18 16:50:28.155117 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 547/1095] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:27 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:28.581442 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:28.582148 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:28.590036 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.590507 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.591384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.591882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.757892 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:28.765882 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c0718eab-82d2-47a0-acfc-91aaf4c40513 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1673 microversion: 2.1 time: 0.188506 Jul 18 16:50:28.767015 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 549/1096] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:28 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:29.178206 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:29.179127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:29.186146 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.186628 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.187401 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.188379 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.353943 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:29.366774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-17e21dee-a562-4b51-82af-21f4ea75fe39 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1554 microversion: 2.1 time: 0.192514 Jul 18 16:50:29.367456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 548/1097] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:29 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:29.784592 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:29.785216 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:29.792460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.792919 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.793746 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.794246 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.386559 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:30.387499 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:30.397119 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.397866 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.399135 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.399738 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.425214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:30.461182 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:30.480135 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3821dfff-c496-4447-a34d-e1396a03da1b tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1673 microversion: 2.1 time: 0.699730 Jul 18 16:50:30.482285 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 550/1098] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:29 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1673 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:30.584214 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:30.595814 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b152b406-41ac-4022-9a43-0124422ca7c5 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1554 microversion: 2.1 time: 0.213233 Jul 18 16:50:30.598177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 549/1099] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:30 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:31.053884 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-0760634a-ef0b-496c-b6a5-90ba4df7570a req-1d491957-f502-48a5-a301-79f72d486fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cad856-84f7-41b3-b0b2-95af46ae309f", "name": "network-vif-deleted", "tag": "19805b70-1ef7-4076-a283-63a2ef8e869f"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:31.072771 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-0760634a-ef0b-496c-b6a5-90ba4df7570a req-1d491957-f502-48a5-a301-79f72d486fa4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.073560 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-0760634a-ef0b-496c-b6a5-90ba4df7570a req-1d491957-f502-48a5-a301-79f72d486fa4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.100732 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-0760634a-ef0b-496c-b6a5-90ba4df7570a req-1d491957-f502-48a5-a301-79f72d486fa4 service nova] Creating event network-vif-deleted:19805b70-1ef7-4076-a283-63a2ef8e869f for instance a2cad856-84f7-41b3-b0b2-95af46ae309f on hv-cinder-83754 Jul 18 16:50:31.113917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-0760634a-ef0b-496c-b6a5-90ba4df7570a req-1d491957-f502-48a5-a301-79f72d486fa4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068743 Jul 18 16:50:31.115400 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 551/1100] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:31.504750 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:31.505798 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:31.536584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.537322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.538717 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.539456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.620307 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:31.621773 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:31.626430 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:31.659240 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.659696 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.660591 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.661032 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.723820 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd66dde93e0f14ce799c9c6294f216781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628c00a1a5df481982b083fa3c447be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:31.743384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.744143 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.744639 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lazy-loading 'fault' on Instance uuid a2cad856-84f7-41b3-b0b2-95af46ae309f {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:50:31.748406 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-64987e55-2781-451c-a997-c23046ced9b5 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 200 len: 1605 microversion: 2.1 time: 0.250144 Jul 18 16:50:31.753486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 550/1101] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:31 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:31.798660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54a5070a23e45a3975c0fa0f2bcc76e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6343e3024ef0469da293401317da07f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:31.811666 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d231bbe7-0af3-48ed-bb0d-49067dfe7b94 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 200 len: 1349 microversion: 2.1 time: 0.197061 Jul 18 16:50:31.812439 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 552/1102] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:31 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 1349 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:32.769282 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.769811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:32.784112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.784112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.784112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.784112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.796950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 HTTP/1.1 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:50:32.799085 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:32.801456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'd354e15b-fcbf-4c9b-b379-d5644fd77b06'} Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:32.802928 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:32.804425 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.805861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:32.805861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-05aad218-23ac-4921-88a5-3bca14d8f7cb tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 404 len: 111 microversion: 2.1 time: 0.035193 Jul 18 16:50:32.805861 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 551/1103] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:32 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:32.811858 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d4e29723-4f71-41d5-9135-643a6de6bce4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '.version_select at 0x7fc3a1debaf0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.832610 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.832957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d4e29723-4f71-41d5-9135-643a6de6bce4 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393160485" status: 202 len: 0 microversion: 2.1 time: 0.024767 Jul 18 16:50:32.833803 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 553/1104] 10.222.0.77 () {58 vars in 1220 bytes} [Mon Jul 18 16:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393160485 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:50:32.833977 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] [instance: a2cad856-84f7-41b3-b0b2-95af46ae309f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:32.848758 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.849518 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.850633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.851111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.875456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] HTTP exception thrown: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Request method failure captured: Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f HTTP/1.1 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y7ABFSmA8HETc7mSNJtalgjvJAGvwvXLjBJaCVOJMj8h4ZZ7MEdOQ43ApouAeccBBt9-zFtchRkl7BReTUocLaS1Go-t4rALy6GOmxEGuLQ1za990xmfiBBoPWMcY1lWv-v3tKKaZw11VNdi61HgUQObzEH9LxwXDOK_a3J0snpqQM Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 6343e3024ef0469da293401317da07f2 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:50:32.878719 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/6343e3024ef0469da293401317da07f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_6343e3024ef0469da293401317da07f2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/6343e3024ef0469da293401317da07f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/6343e3024ef0469da293401317da07f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 6343e3024ef0469da293401317da07f2 Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2102841788 Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestMinimumBasicScenario-2102841788-project Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: b54a5070a23e45a3975c0fa0f2bcc76e Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestMinimumBasicScenario-2102841788-project Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. Jul 18 16:50:32.880461 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'a2cad856-84f7-41b3-b0b2-95af46ae309f'} Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:32.881266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. Jul 18 16:50:32.883443 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:32.885462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Returning 404 to user: Instance a2cad856-84f7-41b3-b0b2-95af46ae309f could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:32.885462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e32bae86-690b-4a13-bd90-ef25225ed134 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f" status: 404 len: 111 microversion: 2.1 time: 0.054372 Jul 18 16:50:32.885462 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 552/1105] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:32 2022] GET /compute/v2.1/servers/a2cad856-84f7-41b3-b0b2-95af46ae309f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:50:32.892038 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-3b5c9570-505e-4fcd-8195-b196e3fc7f86 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] Calling method '.version_select at 0x7fc3a1d29d30>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.919252 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-3b5c9570-505e-4fcd-8195-b196e3fc7f86 tempest-TestMinimumBasicScenario-2102841788 tempest-TestMinimumBasicScenario-2102841788-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2116320906" status: 202 len: 0 microversion: 2.1 time: 0.031564 Jul 18 16:50:32.920265 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 554/1106] 10.222.0.77 () {58 vars in 1271 bytes} [Mon Jul 18 16:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2116320906 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:33.159758 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-6242f759-745a-4197-8978-037c54957eb9 req-08a83758-dc05-498f-bb8a-359c1128e57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d354e15b-fcbf-4c9b-b379-d5644fd77b06", "name": "network-vif-deleted", "tag": "331e9656-e8ae-4723-897f-e7a26127e403"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:33.177101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=37 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:33.183486 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-6242f759-745a-4197-8978-037c54957eb9 req-08a83758-dc05-498f-bb8a-359c1128e57b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:33.184494 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-6242f759-745a-4197-8978-037c54957eb9 req-08a83758-dc05-498f-bb8a-359c1128e57b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:33.199236 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-6242f759-745a-4197-8978-037c54957eb9 req-08a83758-dc05-498f-bb8a-359c1128e57b service nova] Creating event network-vif-deleted:331e9656-e8ae-4723-897f-e7a26127e403 for instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 on hv-cinder-83754 Jul 18 16:50:33.207090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-6242f759-745a-4197-8978-037c54957eb9 req-08a83758-dc05-498f-bb8a-359c1128e57b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051851 Jul 18 16:50:33.207463 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 553/1107] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:36.015930 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:36.017065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:36.028523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.029317 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.030695 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.032487 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.060852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 HTTP/1.1 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:50:36.062608 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.066855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': 'd354e15b-fcbf-4c9b-b379-d5644fd77b06'} Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:36.067900 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.069203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.071239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:36.071239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d39f7c9e-2b44-4e83-be6b-c523b1618538 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 404 len: 111 microversion: 2.1 time: 0.056280 Jul 18 16:50:36.071239 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 555/1108] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:50:36 2022] DELETE /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:36.076330 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:36.077070 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: d354e15b-fcbf-4c9b-b379-d5644fd77b06] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:36.084509 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.085082 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.086075 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.086536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.102759 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 HTTP/1.1 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:50:36.104432 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.107101 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': 'd354e15b-fcbf-4c9b-b379-d5644fd77b06'} Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:36.108504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. Jul 18 16:50:36.111364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:36.113780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance d354e15b-fcbf-4c9b-b379-d5644fd77b06 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:36.113780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ed527dc4-7227-4712-8852-cef5148c81f2 tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06" status: 404 len: 111 microversion: 2.1 time: 0.034547 Jul 18 16:50:36.113780 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 554/1109] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:36 2022] GET /compute/v2.1/servers/d354e15b-fcbf-4c9b-b379-d5644fd77b06 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:50:37.296539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:37.298341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:37.307549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.308211 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.309222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.309852 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.330466 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 HTTP/1.1 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:50:37.333421 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.335008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '2bb2c5ba-19c9-4812-9da4-a074d69d56f4'} Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:37.335943 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.337392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.343361 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:37.345635 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ac7bb18f-dbd0-4e6e-8a2a-51d64651d27d tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 404 len: 111 microversion: 2.1 time: 0.054224 Jul 18 16:50:37.352198 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 556/1110] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:50:37 2022] DELETE /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:37.366195 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:37.367368 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] [instance: 2bb2c5ba-19c9-4812-9da4-a074d69d56f4] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:37.381560 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.382359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.383846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.384617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.413013 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] HTTP exception thrown: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Request method failure captured: Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 HTTP/1.1 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y4nfL7NoMfAqN7xHsTpJzZ1iEoW30iEBcjELjnqrWWQGuSbzExJ0RtcbmkM3-WgxbAk1AkIEvQv_ls7IyvMvgtieR7HJHWvMMpDd9dxgleen24ck6dlPnjW4V7a_3NQQhKoJGVWKYKj_e6AKrx9rirPEDAl1bpnlN5FATt8BE91JLA Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:50:37.416187 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_628c00a1a5df481982b083fa3c447be2", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/628c00a1a5df481982b083fa3c447be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: 628c00a1a5df481982b083fa3c447be2 Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1719989679 Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: d66dde93e0f14ce799c9c6294f216781 Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-AttachVolumeTestJSON-1719989679-project Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.418656 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '2bb2c5ba-19c9-4812-9da4-a074d69d56f4'} Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:37.421544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. Jul 18 16:50:37.424935 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:50:37.427277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] Returning 404 to user: Instance 2bb2c5ba-19c9-4812-9da4-a074d69d56f4 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:37.427277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dc1119f8-3161-4278-80ce-36b763b47e6e tempest-AttachVolumeTestJSON-1719989679 tempest-AttachVolumeTestJSON-1719989679-project] 10.222.0.77 "GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4" status: 404 len: 111 microversion: 2.1 time: 0.062285 Jul 18 16:50:37.427277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 555/1111] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:37 2022] GET /compute/v2.1/servers/2bb2c5ba-19c9-4812-9da4-a074d69d56f4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:55.132646 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:55.133615 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:55.136133 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-19bfb2f6-59f3-4a5f-8945-737a56d238d6 req-d4b67f14-bfd0-4dbb-b7df-4bc42cf02592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7f2b8a-2ed4-4428-ad01-d3d082a66797", "tag": "d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:55.136579 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:55.137170 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=28 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:55.141032 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=5 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:55.141912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=18 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:55.147189 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.147891 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.148886 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.149397 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.149640 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-19bfb2f6-59f3-4a5f-8945-737a56d238d6 req-d4b67f14-bfd0-4dbb-b7df-4bc42cf02592 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.150090 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-19bfb2f6-59f3-4a5f-8945-737a56d238d6 req-d4b67f14-bfd0-4dbb-b7df-4bc42cf02592 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.175887 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-19bfb2f6-59f3-4a5f-8945-737a56d238d6 req-d4b67f14-bfd0-4dbb-b7df-4bc42cf02592 service nova] Creating event network-changed:d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5 for instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 on hv-cinder-83754 Jul 18 16:50:55.188095 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-19bfb2f6-59f3-4a5f-8945-737a56d238d6 req-d4b67f14-bfd0-4dbb-b7df-4bc42cf02592 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055709 Jul 18 16:50:55.189883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 556/1112] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:55.191192 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:50:55.279427 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-f30f57a8-76f7-42e0-9c4d-123fbcd54a96 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 204 len: 0 microversion: 2.1 time: 0.150582 Jul 18 16:50:55.280035 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 557/1113] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:50:55 2022] DELETE /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:50:55.290484 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:55.291204 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:55.298710 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.299157 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.299987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.300415 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.447478 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:55.455384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-85bfdc04-4c48-4095-bfa4-b39be0d570d6 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1578 microversion: 2.1 time: 0.169220 Jul 18 16:50:55.455969 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 557/1114] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:55 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:56.475802 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:56.478029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:56.487516 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.488364 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:56.489467 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.489907 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:56.631537 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:56.639375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-08d77349-8b51-493e-b25d-c3b3ee0c0aff tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1578 microversion: 2.1 time: 0.168961 Jul 18 16:50:56.639950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 558/1115] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:56 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:57.665852 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:57.666501 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:57.675650 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.676107 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.677042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.677630 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.852662 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:57.863216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-6dcf79bd-4069-4226-a416-bf57b64bfcd8 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1578 microversion: 2.1 time: 0.201764 Jul 18 16:50:57.863832 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 558/1116] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:57 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:58.882866 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:58.883620 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:58.890157 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.890650 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.891606 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.892049 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.154969 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:59.163558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2e085300-f134-4093-87a0-4a85c5a7a2d0 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1578 microversion: 2.1 time: 0.284400 Jul 18 16:50:59.164206 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 559/1117] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:58 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1578 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:00.159359 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-b92f448d-8644-4035-b7de-4f69b5de1e75 req-5e285064-03d7-4284-82d9-4e046eccdd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7f2b8a-2ed4-4428-ad01-d3d082a66797", "name": "network-vif-deleted", "tag": "d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:00.172177 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b92f448d-8644-4035-b7de-4f69b5de1e75 req-5e285064-03d7-4284-82d9-4e046eccdd5e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:00.172617 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b92f448d-8644-4035-b7de-4f69b5de1e75 req-5e285064-03d7-4284-82d9-4e046eccdd5e service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.183413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:00.184402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:00.196577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:00.197044 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.200463 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:00.200957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.208844 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-b92f448d-8644-4035-b7de-4f69b5de1e75 req-5e285064-03d7-4284-82d9-4e046eccdd5e service nova] Creating event network-vif-deleted:d32c0bd3-0d47-41bc-a50c-255d8ec5b3d5 for instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 on hv-cinder-83754 Jul 18 16:51:00.214137 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-b92f448d-8644-4035-b7de-4f69b5de1e75 req-5e285064-03d7-4284-82d9-4e046eccdd5e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059119 Jul 18 16:51:00.222251 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 559/1118] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:51:00.308043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:00.316290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fe685911-2d82-495e-8089-f6f2daf5a116 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 200 len: 1226 microversion: 2.1 time: 0.136718 Jul 18 16:51:00.316782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 560/1119] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:00 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:01.334033 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:01.334883 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 4b7f2b8a-2ed4-4428-ad01-d3d082a66797] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:01.342023 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.342544 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.343334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.344266 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.360410 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] HTTP exception thrown: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Request method failure captured: Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 HTTP/1.1 Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y1_acCGawY1Rt1oUtS3WJXCImSR775I4Y34L8NM3KR_v_F1umWClxSMFxUjTvb6lY8A6_IBOQ7N1VP-fj371GZ2nTWfecAX36ouGhD6gMEhFL8vomhPVSwR73nn8wJYQLMbVUbPL0wOZwCqhGwzg1uRE-_0FQV5P_bvJIAFP6eF7Qg Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:51:01.362114 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_edffd84b958d4e2a880fae7c4709d36d", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 6c7e0694c5ab46a4adef7a1f7b1fed4c Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. Jul 18 16:51:01.363840 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '4b7f2b8a-2ed4-4428-ad01-d3d082a66797'} Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:01.365551 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. Jul 18 16:51:01.367534 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:01.369604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Returning 404 to user: Instance 4b7f2b8a-2ed4-4428-ad01-d3d082a66797 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:01.369604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e8acf284-069f-45f7-bb74-67edbf831a0d tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797" status: 404 len: 111 microversion: 2.1 time: 0.033829 Jul 18 16:51:01.369604 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 560/1120] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:01 2022] GET /compute/v2.1/servers/4b7f2b8a-2ed4-4428-ad01-d3d082a66797 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:05.292809 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:05.293528 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:05.301673 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.302282 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.303205 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.303751 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.341089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:51:05.507123 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5f0c722b-7514-4d8f-a567-4119078dd649 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "DELETE /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 204 len: 0 microversion: 2.1 time: 0.220962 Jul 18 16:51:05.507831 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 561/1121] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:51:05 2022] DELETE /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:51:05.520769 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:05.521503 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:05.539694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.540417 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.541555 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.542199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.585648 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-bd7a45e2-adc5-4dea-be7e-ee77917496bc req-e3be4b1a-0ac0-4ea5-9869-74242ea929d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a39496-e159-4eb3-8522-e4c71db90cb2", "tag": "f17f0179-7c66-4506-9262-82d958940f77"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:05.613654 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-bd7a45e2-adc5-4dea-be7e-ee77917496bc req-e3be4b1a-0ac0-4ea5-9869-74242ea929d0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.614942 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-bd7a45e2-adc5-4dea-be7e-ee77917496bc req-e3be4b1a-0ac0-4ea5-9869-74242ea929d0 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.638305 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-bd7a45e2-adc5-4dea-be7e-ee77917496bc req-e3be4b1a-0ac0-4ea5-9869-74242ea929d0 service nova] Creating event network-changed:f17f0179-7c66-4506-9262-82d958940f77 for instance 81a39496-e159-4eb3-8522-e4c71db90cb2 on hv-cinder-83754 Jul 18 16:51:05.652123 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-bd7a45e2-adc5-4dea-be7e-ee77917496bc req-e3be4b1a-0ac0-4ea5-9869-74242ea929d0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351151 Jul 18 16:51:05.653665 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 561/1122] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:06.160022 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:06.175099 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2078d3b5-6cfc-4a07-b8f8-077b4b1bb102 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1575 microversion: 2.1 time: 0.658540 Jul 18 16:51:06.176693 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 562/1123] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:05 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1575 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:07.219934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:07.224384 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:07.242186 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.243116 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.244294 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.245838 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.607562 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:07.627934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-a76af485-e142-4ede-8e15-9a6c61e06431 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1575 microversion: 2.1 time: 0.427493 Jul 18 16:51:07.631426 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 562/1124] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:07 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1575 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:08.240763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-67a16844-e622-4411-83ed-4a3914367c76 req-c0e317d6-311e-41f3-8815-4cffc1a093da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a39496-e159-4eb3-8522-e4c71db90cb2", "name": "network-vif-deleted", "tag": "f17f0179-7c66-4506-9262-82d958940f77"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:08.264103 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-67a16844-e622-4411-83ed-4a3914367c76 req-c0e317d6-311e-41f3-8815-4cffc1a093da service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.264910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-67a16844-e622-4411-83ed-4a3914367c76 req-c0e317d6-311e-41f3-8815-4cffc1a093da service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.297407 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-67a16844-e622-4411-83ed-4a3914367c76 req-c0e317d6-311e-41f3-8815-4cffc1a093da service nova] Creating event network-vif-deleted:f17f0179-7c66-4506-9262-82d958940f77 for instance 81a39496-e159-4eb3-8522-e4c71db90cb2 on hv-cinder-83754 Jul 18 16:51:08.304073 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-67a16844-e622-4411-83ed-4a3914367c76 req-c0e317d6-311e-41f3-8815-4cffc1a093da service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069200 Jul 18 16:51:08.309299 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 563/1125] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:08.654275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:08.655601 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:08.665134 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.668076 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.672313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.676058 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.835022 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7e0694c5ab46a4adef7a1f7b1fed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edffd84b958d4e2a880fae7c4709d36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:08.847704 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-3ec07aab-f645-4241-84a2-d22d0ca4192a tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 200 len: 1225 microversion: 2.1 time: 0.199122 Jul 18 16:51:08.859202 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 563/1126] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:08 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 1225 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:09.872154 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:09.874502 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 81a39496-e159-4eb3-8522-e4c71db90cb2] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:09.888014 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.888801 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.890221 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.891342 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.918486 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] HTTP exception thrown: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Request method failure captured: Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 HTTP/1.1 Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y1_acCGawY1Rt1oUtS3WJXCImSR775I4Y34L8NM3KR_v_F1umWClxSMFxUjTvb6lY8A6_IBOQ7N1VP-fj371GZ2nTWfecAX36ouGhD6gMEhFL8vomhPVSwR73nn8wJYQLMbVUbPL0wOZwCqhGwzg1uRE-_0FQV5P_bvJIAFP6eF7Qg Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:51:09.922458 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_edffd84b958d4e2a880fae7c4709d36d", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 6c7e0694c5ab46a4adef7a1f7b1fed4c Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. Jul 18 16:51:09.924090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '81a39496-e159-4eb3-8522-e4c71db90cb2'} Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:09.924917 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. Jul 18 16:51:09.927271 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:09.928926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Returning 404 to user: Instance 81a39496-e159-4eb3-8522-e4c71db90cb2 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:09.928926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6ef15d31-fd7c-4d63-a476-586403d6e22c tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2" status: 404 len: 111 microversion: 2.1 time: 0.061059 Jul 18 16:51:09.928926 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 564/1127] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:09 2022] GET /compute/v2.1/servers/81a39496-e159-4eb3-8522-e4c71db90cb2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:10.715979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:10.717347 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:10.727449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.728205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.730042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.730536 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.748516 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] HTTP exception thrown: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Request method failure captured: Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: DELETE /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 HTTP/1.1 Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y1_acCGawY1Rt1oUtS3WJXCImSR775I4Y34L8NM3KR_v_F1umWClxSMFxUjTvb6lY8A6_IBOQ7N1VP-fj371GZ2nTWfecAX36ouGhD6gMEhFL8vomhPVSwR73nn8wJYQLMbVUbPL0wOZwCqhGwzg1uRE-_0FQV5P_bvJIAFP6eF7Qg Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:51:10.750702 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_edffd84b958d4e2a880fae7c4709d36d", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 6c7e0694c5ab46a4adef7a1f7b1fed4c Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.752774 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '59c69462-5393-447e-96d5-cda144e8d328'} Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:10.753733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.755675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.757548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Returning 404 to user: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:10.757548 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-dbd8abc4-e050-4d82-bba9-02be860906cf tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "DELETE /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 404 len: 111 microversion: 2.1 time: 0.047495 Jul 18 16:51:10.761322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 564/1128] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:51:10 2022] DELETE /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:10.767921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:10.768867 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] [instance: 59c69462-5393-447e-96d5-cda144e8d328] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:10.777328 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.778265 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.779306 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.779995 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.795279 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.wsgi [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] HTTP exception thrown: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Request method failure captured: Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: request: GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 HTTP/1.1 Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept: application/json Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Accept-Encoding: identity Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Connection: close Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Length: 0 Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Content-Type: application/json Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Host: 10.222.0.77 Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Openstack-System-Scope: None Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Auth-Token: gAAAAABi1Y1_acCGawY1Rt1oUtS3WJXCImSR775I4Y34L8NM3KR_v_F1umWClxSMFxUjTvb6lY8A6_IBOQ7N1VP-fj371GZ2nTWfecAX36ouGhD6gMEhFL8vomhPVSwR73nn8wJYQLMbVUbPL0wOZwCqhGwzg1uRE-_0FQV5P_bvJIAFP6eF7Qg Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Id: None Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Domain-Name: None Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Identity-Status: Confirmed Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Is-Admin-Project: True Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Id: default Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Domain-Name: Default Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Project-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Role: reader,member Jul 18 16:51:10.797791 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Roles: reader,member Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_edffd84b958d4e2a880fae7c4709d36d", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/edffd84b958d4e2a880fae7c4709d36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Id: edffd84b958d4e2a880fae7c4709d36d Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-Tenant-Name: tempest-TestVolumeBootPattern-86073174 Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Id: default Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Domain-Name: Default Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Id: 6c7e0694c5ab46a4adef7a1f7b1fed4c Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: X-User-Name: tempest-TestVolumeBootPattern-86073174-project Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: method: > Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: exception: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.799305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: action_args: {'id': '59c69462-5393-447e-96d5-cda144e8d328'} Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:10.800089 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. Jul 18 16:51:10.801607 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: ERROR nova.api.openstack.wsgi Jul 18 16:51:10.804392 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Returning 404 to user: Instance 59c69462-5393-447e-96d5-cda144e8d328 could not be found. {{(pid=129671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:10.805470 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a77e6bb0-58fc-4744-af97-fd885df13e6f tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328" status: 404 len: 111 microversion: 2.1 time: 0.042457 Jul 18 16:51:10.810162 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 565/1129] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:10 2022] GET /compute/v2.1/servers/59c69462-5393-447e-96d5-cda144e8d328 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:12.546718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7f548879-7d72-4f95-80d7-dee001916384 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] Calling method '.version_select at 0x7fc3a27d35e0>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:12.584317 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7f548879-7d72-4f95-80d7-dee001916384 tempest-TestVolumeBootPattern-86073174 tempest-TestVolumeBootPattern-86073174-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1011843527" status: 202 len: 0 microversion: 2.1 time: 0.044598 Jul 18 16:51:12.585111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 565/1130] 10.222.0.77 () {58 vars in 1262 bytes} [Mon Jul 18 16:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1011843527 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:51:12.588410 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:51:12.589593 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 16:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:51:18.782797 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-ea7f266e-ac37-4da6-bc83-ad72026a75f9 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Action: 'create', calling method: .version_select at 0x7fc3a1d9a1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1208798734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI93uALgWayxzNfceEyMTDBca9MIIJjhgMhVMDrcu0q9zzl3fLp8/5D/k/MSa0W82JTdnawNmErD5km88CUiRyk6ZXMfvZ7gufSoXwhQSDOBjZSrAWI6eEiPz7bHOpfmw=="}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:18.814921 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-ea7f266e-ac37-4da6-bc83-ad72026a75f9 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Getting quotas for project b93b037768d74e83aa4ca3fd2725ee23. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:18.830446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.quota [None req-ea7f266e-ac37-4da6-bc83-ad72026a75f9 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Getting quotas for user 0638500c25cb43d9add4c4fdf8381898 and project b93b037768d74e83aa4ca3fd2725ee23. Resources: {'key_pairs'} {{(pid=129671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:18.881508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-ea7f266e-ac37-4da6-bc83-ad72026a75f9 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.509284 Jul 18 16:51:18.887768 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 566/1131] 10.222.0.77 () {60 vars in 1158 bytes} [Mon Jul 18 16:51:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:35.753323 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=34 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.754216 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.758487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2139019526", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1208798734", "security_groups": [{"name": "tempest-secgroup-smoke-1169914637"}], "networks": [{"uuid": "4659de03-40a7-4562-b3ff-aea00f484081"}], "block_device_mapping_v2": [{"uuid": "835c02f6-35a5-4964-be77-90cb3d8b94f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:35.909047 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.network.neutron [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] validate_networks() for [('4659de03-40a7-4562-b3ff-aea00f484081', None, None, None, None, None)] {{(pid=129672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:36.501010 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Flavor limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:36.501598 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Image limits 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:36.502176 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Flavor pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:36.502726 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Image pref 0:0:0 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:36.503275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.virt.hardware [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:36.514438 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.514898 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.515703 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.516233 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.534765 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Getting quotas for project b93b037768d74e83aa4ca3fd2725ee23. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:36.539585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.quota [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Getting quotas for user 0638500c25cb43d9add4c4fdf8381898 and project b93b037768d74e83aa4ca3fd2725ee23. Resources: {'instances', 'ram', 'cores'} {{(pid=129672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:36.609675 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Going to run 1 instances... {{(pid=129672) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:36.611977 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='835c02f6-35a5-4964-be77-90cb3d8b94f4',volume_size=None,volume_type=None)] {{(pid=129672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:36.757188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-fa51da0d-23a2-4ca9-be27-14a8cbf5c92c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.005553 Jul 18 16:51:36.758277 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 566/1132] 10.222.0.77 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:36.773661 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-38412e7b-f5ca-4e74-9597-198eb3317a20 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:36.774558 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-38412e7b-f5ca-4e74-9597-198eb3317a20 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:36.776782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:36.777556 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=4 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:36.778450 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:36.859394 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-38412e7b-f5ca-4e74-9597-198eb3317a20 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:36.867111 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-38412e7b-f5ca-4e74-9597-198eb3317a20 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1089 microversion: 2.1 time: 0.097496 Jul 18 16:51:36.867811 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 567/1133] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:36 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1089 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:37.896794 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:37.897874 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:37.909126 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.909934 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.911390 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.912175 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.984339 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:37.992278 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ff2e1c7c-3723-4cdc-a084-a3df95c695f4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1187 microversion: 2.1 time: 0.103670 Jul 18 16:51:37.992849 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 567/1134] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:37 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:39.010796 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:39.012218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:39.019460 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.019910 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.020733 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.021237 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.311859 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:39.322234 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-613b6670-3b5f-4ca2-b615-f6139614de18 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.315692 Jul 18 16:51:39.323385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 568/1135] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:39 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:39.879813 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-4f759a86-b921-4cca-90f3-cb7bb4104f51 req-7f752621-e2d7-43fb-8a75-11e733ea3b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:39.889707 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-4f759a86-b921-4cca-90f3-cb7bb4104f51 req-7f752621-e2d7-43fb-8a75-11e733ea3b73 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.890635 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-4f759a86-b921-4cca-90f3-cb7bb4104f51 req-7f752621-e2d7-43fb-8a75-11e733ea3b73 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.904229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-4f759a86-b921-4cca-90f3-cb7bb4104f51 req-7f752621-e2d7-43fb-8a75-11e733ea3b73 service nova] Creating event network-changed:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:51:39.916067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-4f759a86-b921-4cca-90f3-cb7bb4104f51 req-7f752621-e2d7-43fb-8a75-11e733ea3b73 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051055 Jul 18 16:51:39.918287 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 568/1136] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:40.341041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:40.342008 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:40.351230 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.351763 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.352687 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.353183 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.527908 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:40.536472 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-29a42b63-51bd-4780-ab9b-74f2e06ec01c tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.199892 Jul 18 16:51:40.537070 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 569/1137] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:40 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:41.554600 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:41.555315 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:41.563636 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.564112 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.564889 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.565325 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.728496 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.738153 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1e6803c1-4da1-43c6-a525-11d11898275b tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.188222 Jul 18 16:51:41.739167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 569/1138] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:41 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:42.756905 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.757573 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.765094 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.765625 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.766461 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.766901 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.936690 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.945351 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-32ffc0f7-7d22-4f9e-9360-7a45d2d51802 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.192707 Jul 18 16:51:42.946080 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 570/1139] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:43.964174 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.965179 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.974868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.974868 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.975803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.976184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:44.138313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.147229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-7afc6e22-0c02-4e7a-b897-d57eb3e17b09 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.187218 Jul 18 16:51:44.147834 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 570/1140] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:45.166056 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:45.166879 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:45.174308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.174845 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.175719 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.176235 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.334692 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.343660 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-95d063e2-1133-4734-a389-5072fdcdcee3 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.180809 Jul 18 16:51:45.344273 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 571/1141] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:45 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:46.363273 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.364079 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:46.371044 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.371495 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.372280 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.372718 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.520340 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:46.522817 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=2 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.535158 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2eb7c213-b061-4d77-9a6d-41b9174cacf2 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.175616 Jul 18 16:51:46.535660 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 571/1142] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:47.555088 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.555979 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.558957 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell0:SELECT=2 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:47.566597 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.567051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.567851 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.568324 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.756118 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.765134 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2e3e8ca0-043a-494e-aa32-65e87e258d07 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.215864 Jul 18 16:51:47.765738 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 572/1143] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:47 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:48.782729 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.783329 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.785275 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell0:SELECT=6 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:48.791961 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.792416 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.793209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.793680 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.940542 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.948261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c3e94cad-9a38-4332-8d90-f58d58b19fae tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.169477 Jul 18 16:51:48.948839 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 572/1144] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:49.776549 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-88cef21f-40a6-453f-a820-a54320adc5a2 req-5555e316-16b3-48cc-9db5-0236a555e410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "name": "network-vif-plugged", "status": "completed", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:49.791539 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-88cef21f-40a6-453f-a820-a54320adc5a2 req-5555e316-16b3-48cc-9db5-0236a555e410 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.792320 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-88cef21f-40a6-453f-a820-a54320adc5a2 req-5555e316-16b3-48cc-9db5-0236a555e410 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.807340 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.compute.server_external_events [req-88cef21f-40a6-453f-a820-a54320adc5a2 req-5555e316-16b3-48cc-9db5-0236a555e410 service nova] Creating event network-vif-plugged:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:51:49.812418 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-88cef21f-40a6-453f-a820-a54320adc5a2 req-5555e316-16b3-48cc-9db5-0236a555e410 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199045 Jul 18 16:51:49.813090 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 573/1145] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:49.966198 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.967111 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.974830 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.975454 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.976322 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.977386 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.125585 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.133479 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c5710507-54fa-465c-a724-4547e3e58d6e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.171367 Jul 18 16:51:50.134067 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 573/1146] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:51.156356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.157526 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.165538 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.172225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.172225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.172225 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.324200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.339834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4f54d48f-ff69-42ed-ad5f-938d8ed573f5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1261 microversion: 2.1 time: 0.190382 Jul 18 16:51:51.341023 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 574/1147] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:52.357447 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.358155 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.369181 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.369947 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.371389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.372145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.527389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.536394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f66409f2-0e84-48cd-80ae-004db0f7a3d5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1444 microversion: 2.1 time: 0.182895 Jul 18 16:51:52.536987 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 574/1148] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:52.554916 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.555559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.563157 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.563684 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.564519 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.565000 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.723748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.731941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-fd92a526-7371-4c8f-8cbc-55777371377f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1444 microversion: 2.1 time: 0.180899 Jul 18 16:51:52.732611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 575/1149] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:55.158499 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-17e408c2-b7c8-456d-ad16-a6d7c316d97b req-07ba9680-9699-4646-8a35-8701f27ce2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:55.175757 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-17e408c2-b7c8-456d-ad16-a6d7c316d97b req-07ba9680-9699-4646-8a35-8701f27ce2c3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.176407 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-17e408c2-b7c8-456d-ad16-a6d7c316d97b req-07ba9680-9699-4646-8a35-8701f27ce2c3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.202473 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-17e408c2-b7c8-456d-ad16-a6d7c316d97b req-07ba9680-9699-4646-8a35-8701f27ce2c3 service nova] Creating event network-changed:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:51:55.212063 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-17e408c2-b7c8-456d-ad16-a6d7c316d97b req-07ba9680-9699-4646-8a35-8701f27ce2c3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059689 Jul 18 16:51:55.213290 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 575/1150] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:25.626167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:53:25.627243 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Mon Jul 18 16:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:53:50.555532 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=20 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.556508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=44 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.562779 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:50.563408 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.570628 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.571071 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.571847 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.572284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.610655 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.objects.instance [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lazy-loading 'flavor' on Instance uuid 7226a294-1455-45b6-a295-f268e375ac3f {{(pid=129671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:50.699571 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-38b92d2c-f892-4901-9ca2-7f11febb378f tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "POST /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f/action" status: 202 len: 0 microversion: 2.1 time: 0.145710 Jul 18 16:53:50.700222 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 576/1151] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:53:50 2022] POST /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:53:50.708025 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74818cd4-235f-4d1b-8c38-ce2ee421c574] AMQP server on 10.222.0.77:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 16:53:50.709669 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.710897 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=48 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.717038 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.717446 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.725487 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.725929 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.726859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.727301 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.893878 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.908145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ad010d99-4922-492e-9440-a42f492ac45d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.201688 Jul 18 16:53:50.909205 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 576/1152] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:51.936622 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.937341 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.944950 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.945403 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.946199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.946671 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:52.102446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:52.116201 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-2a99ed26-2972-43e4-84c5-88688c661d76 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.184251 Jul 18 16:53:52.117233 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 577/1153] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:53.142799 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:53.143444 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:53.153299 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] [74818cd4-235f-4d1b-8c38-ce2ee421c574] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 33070. Jul 18 16:53:53.159007 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.159500 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.160320 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.160789 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.311470 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.319952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-f6c67b59-cbf9-40fc-b8f9-c89c4bfd954e tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.181881 Jul 18 16:53:53.320613 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 577/1154] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:53 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:54.348232 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.348808 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.355951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.356402 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.357190 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.357627 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.510782 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.519981 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-0abe378e-4c28-41c4-9538-4422471264e5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.175915 Jul 18 16:53:54.520575 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 578/1155] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:55.538701 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.539360 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.547247 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.547690 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.548465 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.548892 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.721558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:55.730144 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-15618a77-5eba-4454-b907-6558a7e93dbb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.195243 Jul 18 16:53:55.730876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 578/1156] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:56.748713 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:56.749277 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:56.756371 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.756823 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.757659 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.758097 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.905561 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:56.913744 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5a917649-2d1b-4188-b338-93459a85852a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.169400 Jul 18 16:53:56.914508 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 579/1157] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:56 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:57.932042 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:57.932673 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:57.940236 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.940684 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.941458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.941890 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.078895 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:58.086672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-19331e38-dd43-4adc-8938-60ae1f3360c0 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.158432 Jul 18 16:53:58.087337 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 579/1158] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:57 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:59.106951 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:59.107772 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:59.118899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.119662 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.121012 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.121780 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.280173 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.288706 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-6d9662dd-555f-467f-a72b-fe5324780a74 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.187737 Jul 18 16:53:59.289308 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 580/1159] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:59 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:00.306437 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.307066 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.313823 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.314291 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.315503 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.316028 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.459952 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:00.469145 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-18706ad3-513d-41e5-877e-f2f4def3f067 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.166507 Jul 18 16:54:00.469733 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 580/1160] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:01.486942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:01.487714 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.494385 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.494853 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.495619 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.496043 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.632367 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.640506 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a825d88d-0aa1-4461-8e7b-43b7ca581abc tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.157450 Jul 18 16:54:01.641081 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 581/1161] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:01 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:02.657307 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.657912 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.664543 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.664983 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.665751 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.666167 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.813979 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:02.821458 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-c9de2922-8aa7-4d0c-8e41-dfb1cb161471 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.168266 Jul 18 16:54:02.822015 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 581/1162] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:03.838817 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:03.839377 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:03.845924 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.846375 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.847174 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.847616 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.988218 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.995726 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-d0478cd5-da30-4463-a586-0e644913ec17 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1569 microversion: 2.1 time: 0.161026 Jul 18 16:54:03.996291 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 582/1163] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:03 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.014513 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:04.015184 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.021633 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.022099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.022925 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.023364 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.098803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-67a04f68-70a7-4cb7-83f5-6e6b4bed52b1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "POST /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f/action" status: 202 len: 0 microversion: 2.1 time: 0.088570 Jul 18 16:54:04.099328 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 582/1164] 10.222.0.77 () {60 vars in 1277 bytes} [Mon Jul 18 16:54:04 2022] POST /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:54:04.107757 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.108383 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.114755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.115284 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.116185 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.116523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.266818 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:04.274862 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-9d4e971b-8cab-4211-b498-231ea49eb48d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1517 microversion: 2.1 time: 0.171320 Jul 18 16:54:04.275446 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 583/1165] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:05.293558 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:05.294306 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:05.300886 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.301335 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.302118 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.302593 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.441818 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:05.449454 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-4d120770-6344-4d0f-9609-d50589bc4595 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1517 microversion: 2.1 time: 0.160230 Jul 18 16:54:05.450021 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 583/1166] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:05 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:06.324946 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [req-c015b43e-3bd3-4b25-9170-bc59382d1ff9 req-e133fffc-ecd8-4b7f-a487-3870bb2296b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "name": "network-vif-unplugged", "status": "completed", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:06.335215 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-c015b43e-3bd3-4b25-9170-bc59382d1ff9 req-e133fffc-ecd8-4b7f-a487-3870bb2296b3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.335775 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [req-c015b43e-3bd3-4b25-9170-bc59382d1ff9 req-e133fffc-ecd8-4b7f-a487-3870bb2296b3 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.349885 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.compute.server_external_events [req-c015b43e-3bd3-4b25-9170-bc59382d1ff9 req-e133fffc-ecd8-4b7f-a487-3870bb2296b3 service nova] Unable to find a host for instance 7226a294-1455-45b6-a295-f268e375ac3f. Dropping event network-vif-unplugged {{(pid=129671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 16:54:06.350869 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [req-c015b43e-3bd3-4b25-9170-bc59382d1ff9 req-e133fffc-ecd8-4b7f-a487-3870bb2296b3 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029771 Jul 18 16:54:06.351485 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 584/1167] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 16:54:06.469978 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:06.470846 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:06.478369 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.478950 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.479816 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.480348 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.637686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:06.651857 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-5f0b90e8-ba99-4bb9-8db0-0dd156786936 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1517 microversion: 2.1 time: 0.188241 Jul 18 16:54:06.652351 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 584/1168] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:06 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:07.673481 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:07.674203 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:07.680601 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.681074 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.681876 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.682316 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.832066 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:07.839873 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-5d2b13bb-b614-4b61-b0db-0d9498c1d8a8 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1517 microversion: 2.1 time: 0.171326 Jul 18 16:54:07.840456 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 585/1169] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:07 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:08.858982 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:08.860188 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:08.871704 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.873004 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.874434 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.875237 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:09.024411 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:09.032334 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-e8d2fbff-b124-4d6a-a5bb-656cefbe1e4d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.178676 Jul 18 16:54:09.032906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 585/1170] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:08 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:10.050045 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:10.050702 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:10.057894 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.058348 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.059181 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.060224 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.400942 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:10.409517 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-146ab9fc-f8d5-4d7e-b02b-a8384c4866ad tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.363399 Jul 18 16:54:10.410122 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 586/1171] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:10 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:11.427575 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:11.428192 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:11.435930 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:11.436372 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:11.437165 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:11.437603 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:11.590680 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:11.598880 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1074a97e-4fd5-44ee-b803-6aa9b5da100d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.175230 Jul 18 16:54:11.599449 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 586/1172] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:11 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:12.616413 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:12.617065 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:12.624465 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.624918 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.625694 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.626129 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.768500 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:12.776314 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c80bf867-d327-4af9-8591-61b2698bf9d4 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.163697 Jul 18 16:54:12.776902 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 587/1173] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:12 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:13.794050 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:13.794975 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:13.801772 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:13.802225 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.803074 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:13.803504 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.947220 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:13.955532 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-978ddc74-71ee-4103-8959-f47da0362281 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.165404 Jul 18 16:54:13.956203 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 587/1174] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:13 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:14.973179 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:14.973824 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:14.981077 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.981522 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.982305 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.982766 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.127554 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:15.135570 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-8304ec9e-5983-40c7-b496-cd237de3cabb tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.166368 Jul 18 16:54:15.136158 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 588/1175] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:14 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.152679 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.153876 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.160680 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.161127 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.161901 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.162353 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.295761 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.303304 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-ebb5003b-e8f1-4c86-b6bd-51bc08e5fb9a tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.154505 Jul 18 16:54:16.303859 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 588/1176] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.455290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:54:16.455855 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 16:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:54:17.320881 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.321533 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.328545 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.328991 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.329754 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.330186 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.461482 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:17.469546 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-aa05a3f2-4740-474e-bf5d-299802c8a14d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.152552 Jul 18 16:54:17.470105 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 589/1177] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:17 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:18.486914 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:18.487824 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:18.494261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.494815 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:18.495586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.496019 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:18.628612 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:18.636099 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-1d0a6df0-982e-4c45-bfc2-ea2f0b68d006 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.154288 Jul 18 16:54:18.636668 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 589/1178] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:18 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:19.653384 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:19.654041 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:19.661108 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.661559 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.662327 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.662795 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.791755 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:19.799583 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-4225d4e4-4ef3-4809-8a77-7dd89f9df627 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.150178 Jul 18 16:54:19.800161 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 590/1179] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:19 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:20.551313 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-b83abff1-068f-4fe9-8566-449a7330131d req-b1fe7e4d-adbc-4e8e-98b7-a8248a78512b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "name": "network-vif-plugged", "status": "completed", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:20.560389 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b83abff1-068f-4fe9-8566-449a7330131d req-b1fe7e4d-adbc-4e8e-98b7-a8248a78512b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.561387 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-b83abff1-068f-4fe9-8566-449a7330131d req-b1fe7e4d-adbc-4e8e-98b7-a8248a78512b service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.572803 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-b83abff1-068f-4fe9-8566-449a7330131d req-b1fe7e4d-adbc-4e8e-98b7-a8248a78512b service nova] Creating event network-vif-plugged:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:54:20.577989 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-b83abff1-068f-4fe9-8566-449a7330131d req-b1fe7e4d-adbc-4e8e-98b7-a8248a78512b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030338 Jul 18 16:54:20.578796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 590/1180] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:20.818147 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:20.818813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:20.821064 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=31 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:20.827689 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.828143 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.828932 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.829356 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.832523 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:21.005630 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:21.013366 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-436e066b-edd1-4860-ac0a-68ed5e747d3d tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.199060 Jul 18 16:54:21.013941 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 591/1181] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:20 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:22.032683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.033366 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.035377 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=33 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:22.041008 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.041456 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.042224 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.042683 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.046024 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:22.198988 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:22.207267 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-b1f4e809-d4ca-4452-b202-65416f113f15 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1562 microversion: 2.1 time: 0.179814 Jul 18 16:54:22.207850 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 591/1182] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:22 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:32.628062 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:54:32.628603 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 16:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:55:36.511037 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_api:SELECT=1 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:36.512349 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG dbcounter [-] [129671] Writing DB stats nova_cell1:SELECT=5 {{(pid=129671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:36.515229 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-ebd2a656-b13d-4a8e-8ef1-496968d36667 req-537c71a4-ad83-4454-955b-a33a98b67ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:36.516121 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.517199 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:36.522967 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_api:SELECT=1 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:36.523616 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG dbcounter [-] [129672] Writing DB stats nova_cell1:SELECT=5 {{(pid=129672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:36.525200 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.525656 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.525962 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-ebd2a656-b13d-4a8e-8ef1-496968d36667 req-537c71a4-ad83-4454-955b-a33a98b67ae4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.526586 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-ebd2a656-b13d-4a8e-8ef1-496968d36667 req-537c71a4-ad83-4454-955b-a33a98b67ae4 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.526947 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.527431 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.538734 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-ebd2a656-b13d-4a8e-8ef1-496968d36667 req-537c71a4-ad83-4454-955b-a33a98b67ae4 service nova] Creating event network-changed:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:55:36.544219 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-ebd2a656-b13d-4a8e-8ef1-496968d36667 req-537c71a4-ad83-4454-955b-a33a98b67ae4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033048 Jul 18 16:55:36.545131 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 592/1183] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:36.554223 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Going to try to terminate instance {{(pid=129671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:55:36.652577 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-a380b59b-9c5d-4af9-ba3a-d03739057187 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "DELETE /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 204 len: 0 microversion: 2.1 time: 0.142997 Jul 18 16:55:36.653250 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 592/1184] 10.222.0.77 () {58 vars in 1238 bytes} [Mon Jul 18 16:55:36 2022] DELETE /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:55:36.664209 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.664909 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:36.672623 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.673672 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.674688 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.675161 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.924648 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.policy [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129672) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:36.932268 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-732096d0-2d5b-4d34-9e74-36aa292adba6 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.274291 Jul 18 16:55:36.932837 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 593/1185] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:36 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:37.949899 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:37.950703 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:37.956839 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.957290 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.958051 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.958530 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.220447 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.228007 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-b3d6102c-f337-4770-94ab-c2cf30875347 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.282465 Jul 18 16:55:38.228573 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 593/1186] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:37 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:38.928634 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [req-ec114e43-15f2-47ce-8657-6b45e11a68b8 req-384d9641-fd9b-4058-8a2d-aca1f4034555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7226a294-1455-45b6-a295-f268e375ac3f", "name": "network-vif-deleted", "tag": "b3e91bc7-39bd-44e9-a541-261a27efeec2"}]} {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:38.936686 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-ec114e43-15f2-47ce-8657-6b45e11a68b8 req-384d9641-fd9b-4058-8a2d-aca1f4034555 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.937120 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [req-ec114e43-15f2-47ce-8657-6b45e11a68b8 req-384d9641-fd9b-4058-8a2d-aca1f4034555 service nova] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.948283 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.compute.server_external_events [req-ec114e43-15f2-47ce-8657-6b45e11a68b8 req-384d9641-fd9b-4058-8a2d-aca1f4034555 service nova] Creating event network-vif-deleted:b3e91bc7-39bd-44e9-a541-261a27efeec2 for instance 7226a294-1455-45b6-a295-f268e375ac3f on hv-cinder-83754 Jul 18 16:55:38.953012 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [req-ec114e43-15f2-47ce-8657-6b45e11a68b8 req-384d9641-fd9b-4058-8a2d-aca1f4034555 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090147 Jul 18 16:55:38.953599 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 594/1187] 10.222.0.77 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:39.245168 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:39.245844 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.compute.api [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129671) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:39.257309 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.257748 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.258581 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.259021 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG oslo_concurrency.lockutils [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.324095 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.policy [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0638500c25cb43d9add4c4fdf8381898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93b037768d74e83aa4ca3fd2725ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129671) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.332142 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-11ff4ec3-bda4-4b28-a713-9b25be63e0b5 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 200 len: 1220 microversion: 2.1 time: 0.090903 Jul 18 16:55:39.332834 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 594/1188] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:39 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:40.350699 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '>' {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.351394 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.compute.api [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] [instance: 7226a294-1455-45b6-a295-f268e375ac3f] Fetching instance by UUID {{(pid=129672) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:40.357615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.358068 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.358865 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.359299 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG oslo_concurrency.lockutils [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Lock "9733f778-78e8-48ae-a8ab-3c482e4cde64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.372811 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.wsgi [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] HTTP exception thrown: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Request method failure captured: Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: request: GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f HTTP/1.1 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept: application/json Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Accept-Encoding: identity Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Connection: close Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Length: 0 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Content-Type: application/json Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Host: 10.222.0.77 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Openstack-System-Scope: None Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: User-Agent: python-urllib3/1.26.9 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Auth-Token: gAAAAABi1Y99Bl7mvwI-IiFLC9qlmxtMOPXHeVugm-Ojb5nzf6gKkv7pXFcYiklFVjAUJLPIIKOEoWGj5f-oYAOUdIitQ1LWuKwV3bX56-8MrNROR6uav19BEClgMrMYAsTp-Y3R7O-P-og9OY_frcdn31-BMzUprs8_axL1gOOLdr4vwJu0gD4 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Id: None Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Domain-Name: None Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Identity-Status: Confirmed Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Is-Admin-Project: True Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Id: default Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Domain-Name: Default Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Id: b93b037768d74e83aa4ca3fd2725ee23 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Project-Name: tempest-TestShelveInstance-195816611 Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Role: reader,member Jul 18 16:55:40.374431 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Roles: reader,member Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/b93b037768d74e83aa4ca3fd2725ee23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_b93b037768d74e83aa4ca3fd2725ee23", "adminURL": "http://10.222.0.77:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b93b037768d74e83aa4ca3fd2725ee23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/b93b037768d74e83aa4ca3fd2725ee23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}] Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant: tempest-TestShelveInstance-195816611 Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Id: b93b037768d74e83aa4ca3fd2725ee23 Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-Tenant-Name: tempest-TestShelveInstance-195816611 Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User: tempest-TestShelveInstance-195816611-project Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Id: default Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Domain-Name: Default Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Id: 0638500c25cb43d9add4c4fdf8381898 Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: X-User-Name: tempest-TestShelveInstance-195816611-project Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: method: > Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: exception: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. Jul 18 16:55:40.376338 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: action_args: {'id': '7226a294-1455-45b6-a295-f268e375ac3f'} Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: {{(pid=129672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:55:40.377584 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. Jul 18 16:55:40.379485 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: ERROR nova.api.openstack.wsgi Jul 18 16:55:40.381048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: DEBUG nova.api.openstack.wsgi [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Returning 404 to user: Instance 7226a294-1455-45b6-a295-f268e375ac3f could not be found. {{(pid=129672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:55:40.381048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO nova.api.openstack.requestlog [None req-2d3ba173-3508-44d4-83a0-c1717f031195 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f" status: 404 len: 111 microversion: 2.1 time: 0.029850 Jul 18 16:55:40.381048 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: [pid: 129672|app: 0|req: 595/1189] 10.222.0.77 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:40 2022] GET /compute/v2.1/servers/7226a294-1455-45b6-a295-f268e375ac3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:55:40.539611 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: DEBUG nova.api.openstack.wsgi [None req-c586cb84-158f-4d9c-a0fd-b441b1cbd7c1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] Calling method '.version_select at 0x7fc3a1ec30d0>' {{(pid=129671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.577560 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO nova.api.openstack.requestlog [None req-c586cb84-158f-4d9c-a0fd-b441b1cbd7c1 tempest-TestShelveInstance-195816611 tempest-TestShelveInstance-195816611-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208798734" status: 202 len: 0 microversion: 2.1 time: 0.041937 Jul 18 16:55:40.578165 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: [pid: 129671|app: 0|req: 595/1190] 10.222.0.77 () {58 vars in 1253 bytes} [Mon Jul 18 16:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208798734 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:45.636196 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:56:45.636796 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Mon Jul 18 16:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:57:52.636521 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:57:52.637039 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 16:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:58:10.747264 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:58:10.747906 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Mon Jul 18 16:58:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:58:15.906139 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:58:15.906813 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 16:58:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:59:25.386992 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:59:25.387615 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Mon Jul 18 16:59:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:00:05.644592 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:00:05.645261 dv-cinder-837543-6-iscsi devstack@n-api.service[129672]: Mon Jul 18 17:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:00:56.467029 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:00:56.467750 dv-cinder-837543-6-iscsi devstack@n-api.service[129671]: Mon Jul 18 17:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!